Principal Software Engineer - Insights & Intelligence
New
J
JobgetherData engineering
Based in United StatesFull-TimePrincipal
SalaryAnnual base salary range of $103,600–$155,400
Apply NowOpens the employer's application page
Job Details
- Experience
- Bachelor’s degree in Computer Science, Software Engineering, or a related technical discipline with at least 5 years of relevant professional experience, or a Master’s degree with at least 3 years of relevant experience.
- Required Skills
- AWSPythonGitSparkCI/CDRESTful APIsTerraformDatabricksGitHub Actions
Requirements
- Hold a bachelor’s degree in Computer Science, Software Engineering, or a related technical discipline with at least 5 years of relevant professional experience, or a master’s degree with at least 3 years of relevant experience.
- Have professional experience in software development, DevOps, platform engineering, data engineering, or a closely related field.
- Demonstrate advanced proficiency in Python and the ability to develop robust, maintainable, reusable, well-tested production code.
- Have strong experience developing CI/CD workflows using GitHub Actions, GitLab CI/CD, or comparable automation platforms.
- Understand CI/CD practices for software systems, data platforms, or infrastructure.
- Have knowledge of source control, automated testing, deployment automation, production support, and software engineering best practices.
- Be able to troubleshoot complex production environments, including workflow failures, data-quality problems, performance bottlenecks, and infrastructure incidents.
- Experience with infrastructure as code in a major cloud environment using Terraform, REST APIs, or comparable technologies is preferred.
- Hands-on experience with Databricks, Apache Spark, and AWS services such as Amazon S3, AWS Batch, Amazon MSK, or Apache Kafka is highly desirable.
- Experience managing multi-tenant Databricks environments is a plus.
- Familiarity with Unity Catalog, Delta Lake, Databricks Workflows, Databricks Asset Bundles, and SQL warehouses is preferred.
- Experience with enterprise authentication and authorization, identity federation, service principals, role-based access control, and secrets management is valuable.
- An active U.S. Government Secret clearance is preferred.
Responsibilities
- Design, implement, and maintain monitoring, alerting, and logging for production data pipelines.
- Build and maintain CI/CD pipelines for data applications and infrastructure.
- Enable controlled deployments across development, testing, and production environments.
- Diagnose and resolve workflow failures, performance bottlenecks, data-quality issues, and infrastructure incidents.
- Apply software engineering and DevOps practices to improve platform resilience, maintainability, scalability, and supportability.
- Design, develop, and optimize scalable data integrations from enterprise source systems.
- Establish standards for code quality, architecture, documentation, automated testing, and production support.
- Partner with data engineers, platform engineers, and architects to deliver stable, secure data services.
- Contribute to observability, incident response, performance optimization, and reliability practices.
View Full Description & ApplyYou'll be redirected to the employer's site
