Staff Software Engineer - OpenTelemetry Python Instrumentation

New

Grafana LabsObservability software

This is a remote opportunity and we would be interested in applications from Germany, UK, Ireland and Spain.Full-TimeStaff

SalaryIn the UK, the compensation range for this role is GBP 107,000 - GBP 134,000. All of our roles include Restricted Stock Units (RSUs)

Apply NowOpens the employer's application page

Job Details

Have 8+ years of experience in software development.
Demonstrate strong proficiency in Python.
Have experience debugging production software, language internals, libraries, and asynchronous code.
Have experience working in open-source communities and be willing to participate actively in the OpenTelemetry community.
Be familiar with observability tooling such as Grafana, Prometheus, and OpenTelemetry.
Have experience with cloud-based software or systems engineering and understand production environments and operational risks.
Have an interest in AI applications and agent systems; prior experience building AI systems is helpful but not required.
Bonus: Experience with open-source observability projects, ideally OpenTelemetry or Prometheus.
Bonus: Experience with Python instrumentation, profiling, runtime diagnostics, or asynchronous context propagation.
Bonus: Experience in hands-on technical leadership, setting technical direction, or leading project teams.
Bonus: Experience instrumenting AI frameworks or agent workflows, or working with OpenTelemetry semantic conventions for generative AI.
Bonus: Experience contributing to or maintaining open-source projects, with successful pull requests and community collaboration.
Bonus: Rust experience for exploring Python SDK performance improvements, including Rust-backed implementations.

Develop and maintain the OpenTelemetry Python SDK and instrumentation libraries with maintainers and other vendors.
Build Python instrumentation connecting AI agent runs, model calls, and tool execution, including across asynchronous code.
Contribute to OpenTelemetry conventions for generative AI while considering sensitive data and metric cardinality.
Use profiling and benchmarks to evaluate SDK implementation approaches and tradeoffs in runtime overhead, compatibility, and maintainability.
Teach others and promote best practices for OpenTelemetry, semantic conventions, and related technologies and frameworks.
Support the team's technical direction and contribute to business conversations about Grafana Labs' OpenTelemetry strategy.
Own projects from problem definition through design, implementation, testing, documentation, and release.
Partner with GTM, Product, and Support teams; join customer conversations, investigate instrumentation issues, and develop fixes and practical guidance.

View Full Description & ApplyYou'll be redirected to the employer's site