GCP Data Engineer - Lead Consultant
L
LingaroCloud Data Engineering
IndiaFull-TimeLead
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- PythonSQLETLGCPGitJiraAirflowData modelingBigQuery
Requirements
- 7+ years of experience as a Data Engineer working with GCP cloud-based infrastructure and systems.
- Deep knowledge of Google Cloud Platform and cloud computing services.
- Extensive experience designing, building, and deploying data pipelines to ingest data from databases, APIs, or streaming platforms.
- Proficiency in database management systems including SQL (BigQuery is required) and NoSQL.
- Strong programming skills in Python and other scripting languages.
- Proficiency in data modeling techniques, query optimization, indexing, and performance tuning.
- Knowledge of at least one orchestration and scheduling tool (Airflow is required).
- Experience with data integration tools and techniques, such as ETL and ELT.
- Knowledge of modern data transformation tools such as DBT or Dataform.
- Excellent communication skills for cross-functional collaboration and explaining technical concepts to non-technical stakeholders.
- Experience working in multinational environments and distributed teams.
- Proficiency with Git, Jira, and Confluence.
Responsibilities
- Design, model and develop comprehensive GCP data ecosystems for clients using tools like Cloud Storage, Cloud Functions, and BigQuery.
- Gather, analyze, model, and document business and technical requirements through direct client interaction.
- Design and optimize data storage architectures, including data lakes, data warehouses, and distributed file systems.
- Identify and resolve bottlenecks, tune queries, and implement caching strategies to improve system efficiency.
- Monitor system performance, conduct root cause analysis, and resolve issues related to data processing or infrastructure.
- Train and mentor less experienced data engineers through knowledge transfer and guidance.
- Lead discussions with clients to identify and assess avenues for technical improvement.
View Full Description & ApplyYou'll be redirected to the employer's site
