Using the Human-in-the-Loop approach, this workshop offers an overview of the design, development, and quality control of automated item generation using Generative AI applications. Through hands-on activities, participants will explore various assessment techniques to ensure that quality assessments are developed to enhance rigor, validity, and interpretability in pipeline design.