Apply

Lead Engineer, Back-end

Posted 2024-11-13

View full description

💎 Seniority level: Lead, 8 years minimum

📍 Location: New York City, NOT STATED

💸 Salary: 150000 - 175000 USD per year

🔍 Industry: Digital creative agency

🏢 Company: Code and Theory

⏳ Experience: 8 years minimum

🪄 Skills: AWSDockerPythonSoftware DevelopmentSQLApache AirflowKafkaKubernetesPyTorchRabbitmqAirflowApache KafkaAzureGrafanagRPCPrometheusNosqlTensorflowCollaborationCI/CDRESTful APIsDevOpsTerraformDocumentationMicroservicesCompliance

Requirements:
  • 8 years minimum experience in software programming, specializing in back-end development.
  • Proven experience with Python; Go or Java is a plus.
  • Deep understanding of designing complex workflows; experience with LangChain is a plus.
  • Familiarity with AI frameworks like TensorFlow or PyTorch, and working knowledge of LLMs.
  • Experience with RESTful APIs, gRPC, and asynchronous communication.
  • Proficiency with SQL and NoSQL databases, including state management.
  • Experience with message brokers like RabbitMQ or Apache Kafka.
  • Experience with Docker and Kubernetes for application deployment.
  • Understanding of secure coding practices and data encryption.
  • Experience with Retrieval-Augmented Generation (RAG) systems.
  • Working knowledge of CI/CD pipelines and cloud platforms.
  • Experience with monitoring and logging tools like Prometheus or ELK Stack.
  • Strong experience with workflow orchestration tools like Prefect or Apache Airflow.
  • Proven experience in building distributed systems and microservices architecture.
Responsibilities:
  • Be a hands-on leader to engineering teams in successfully delivering scalable, maintainable, and secure features to customers.
  • Integrate Foundation Model LLMs and internal RAG systems into backend services.
  • Implement workflow orchestration logic to manage task dependencies.
  • Collaborate with AI specialists for effective integration.
  • Ensure system scalability and efficiency for handling high loads.
  • Implement asynchronous processing, caching, and optimize communication protocols.
  • Set up logging, monitoring, and alerting mechanisms.
  • Adhere to data privacy and security best practices.
  • Write clear technical documentation.
  • Develop and conduct thorough testing.
  • Complete tasks in a timely manner and foster collaboration.
Apply