Staff Software Engineer - OpenTelemetry Python Instrumentation
New
G
Grafana LabsObservability software
This is a remote opportunity and we would be interested in applications from Germany, UK, Ireland and Spain.Full-TimeStaff
SalaryIn Ireland, the compensation range for this role is EUR 121,000 - EUR 151,000.
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years of experience in software development
- Required Skills
- PythonGrafanaPrometheus
Requirements
- Have 8+ years of experience in software development.
- Demonstrate strong proficiency in Python.
- Have experience debugging production software, language internals, libraries, and asynchronous code.
- Bring an interest in AI applications and agent systems, and curiosity about instrumenting and troubleshooting them.
- Have experience working in open-source communities and willingness to participate in the OpenTelemetry community.
- Be familiar with observability tooling such as Grafana, Prometheus, and OpenTelemetry.
- Have experience with cloud-based software or systems engineering and an understanding of production environments and operational risks.
- Bonus: Bring experience in open-source observability projects, ideally OpenTelemetry or Prometheus.
- Bonus: Have experience with Python instrumentation techniques, profiling, runtime diagnostics, or asynchronous context propagation.
- Bonus: Have hands-on technical leadership experience, setting technical direction and leading project teams.
- Bonus: Have experience instrumenting AI frameworks or agent workflows, or with OpenTelemetry semantic conventions for generative AI.
- Bonus: Bring experience contributing to or maintaining open-source projects, including successful pull requests and community collaboration.
- Bonus: Have Rust experience for exploring Python SDK performance improvements, including Rust-backed implementations.
Responsibilities
- Develop and maintain the OpenTelemetry Python SDK and instrumentation libraries in collaboration with maintainers and other vendors.
- Build Python instrumentation connecting AI agent runs, model calls, and tool execution, including across asynchronous code.
- Contribute to OpenTelemetry conventions for generative AI, considering sensitive data and metric cardinality.
- Evaluate Python SDK implementation approaches using profiling and benchmarks, balancing runtime overhead, compatibility, and maintainability.
- Teach others and promote best practices for OpenTelemetry, semantic conventions, and related technologies and frameworks.
- Support the team's technical direction and contribute to Grafana Labs' OpenTelemetry strategy.
- Own projects through design, implementation, testing, documentation, and release.
- Partner with GTM, Product, and Support teams, join customer conversations, investigate instrumentation issues, and produce fixes and practical guidance.
View Full Description & ApplyYou'll be redirected to the employer's site
