Sr Generative AI Scientist II - Model Risk
New
C
CotivitiHealthcare Technology
United StatesFull-TimeSenior
Salary153,000 - 180,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- PythonCloud ComputingMachine LearningPyTorchData scienceSparkTensorflowGenerative AI
Requirements
- Graduate Degree in a quantitative discipline such as Computer Science/Engineering, Statistics, or Operations Research.
- 5+ years of hands-on data science/AI experience.
- Experience with natural language processing including transformers, fine-tuning LLMs, and deployment tools (HuggingFace, Langchain, LLAMA/Mistral, OpenAI, vector databases).
- Proficiency with machine learning tools including pandas, scikit-learn, keras, nltk, TensorFlow, PyTorch, and GPU computing.
- Understanding of Responsible AI (RAI) concepts including explainability (XAI), AI NIST RMF, bias, fairness, SHAP, and LIME.
- Experience building production-grade machine learning deployments on AWS, Azure, or GCP.
- Experience working with Apache Spark and large-scale distributed datasets.
- Understanding of model metrics and evaluation techniques for GenAI and LLMs.
Responsibilities
- Conduct independent model validation of existing models for benchmarking, assessment, and gauging effectiveness.
- Determine aspects of model drift and data drift for model risk management (MRM) purposes.
- Apply deep expertise with AI/ML/GenAI model development, including hands-on model building and evaluation.
- Benchmark and rebuild existing models as needed using updated data and modern algorithms.
- Drive improvements in model monitoring activities, including methods for model registration and metadata management.
- Conceptualize approaches for tools and techniques related to model lifecycle management.
View Full Description & ApplyYou'll be redirected to the employer's site
