Staff Software Engineer - OpenTelemetry Python Instrumentation
New
G
Grafana LabsObservability software
This is a remote opportunity and we would be interested in applications from Germany, UK, Ireland and Spain.Full-TimeStaff
SalaryIn the UK, the compensation range for this role is GBP 107,000 - GBP 134,000.
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years of experience in software development
- Required Skills
- PythonGrafanaPrometheusRust
Requirements
- Have 8+ years of experience in software development.
- Bring strong proficiency in Python.
- Have experience debugging production software, language internals, libraries, and asynchronous code.
- Be interested in AI applications and agent systems, with curiosity about instrumenting and troubleshooting them.
- Have experience working in open-source communities and be willing to participate in the OpenTelemetry community.
- Be familiar with observability tooling such as Grafana, Prometheus, and OpenTelemetry.
- Have experience with cloud-based software or systems engineering and understand production environments and operational risks.
- Python instrumentation, profiling, runtime diagnostics, or asynchronous context propagation experience is a bonus.
- Experience instrumenting AI frameworks or agent workflows, or working with OpenTelemetry semantic conventions for generative AI, is a bonus.
- Rust experience is a plus.
Responsibilities
- Develop and maintain the OpenTelemetry Python SDK and instrumentation libraries with maintainers and other vendors.
- Build Python instrumentation connecting agent runs, model calls, and tool execution, including across asynchronous code.
- Contribute to OpenTelemetry conventions for generative AI while considering sensitive data and metric cardinality.
- Use profiling and benchmarks to evaluate SDK implementation approaches and tradeoffs in runtime overhead, compatibility, and maintainability.
- Teach others and promote best practices for OpenTelemetry, semantic conventions, and related technologies and frameworks.
- Support the team's technical direction and contribute to OpenTelemetry strategy discussions.
- Own projects from problem definition through design, implementation, testing, documentation, and release.
- Partner with GTM, Product, and Support teams; join customer conversations, investigate instrumentation issues, and turn findings into fixes and guidance.
View Full Description & ApplyYou'll be redirected to the employer's site