Data Pipeline AgTech Engineer
77500 - 107000 USD per year
Company:Sensei Ag
Location:US
Languages:English
Seniority level:Junior, 1+ year
Experience:1+ year
Skills:
AWSPythonSQLETLGCPAzureData engineeringPandasTroubleshootingData modelingSoftware EngineeringDebugging
Requirements:
Minimum of 1 year of data pipeline and/or software engineering experience. Solid understanding of data engineering fundamentals. Experience with Python, SQL, and Python data science libraries (Pandas, PySpark). Strong proficiency in querying and manipulating large datasets using SQL and Python. Familiarity with efficient big data formats. Familiarity with data modeling and database design principles. Excellent problem-solving and analytical skills. Strong communication and collaboration skills. Bachelor's degree in Computer Science, Data Science or related field.
Responsibilities:
Collaborate with cross-functional teams to understand data requirements. Build scalable data pipelines for faster insights and model building. Design, build, and maintain robust data pipelines and processing systems. Implement data quality frameworks. Optimize data storage and retrieval. Stay updated with industry trends in data engineering.
