Additional Study Information: The purpose of this study is to see if amivantamab in combination with administration of standard of care chemotherapy (carboplatin and pemetrexed) is safe and useful for treating patients with Non-Small Cell Lung Cancer (NSCLC), specifically in patients with a gene abnormality called EGFR Exon 20 insertions. There are two study arms for this trial. Patients on Study Treatment Arm A will receive the investigational drug (amivantamab) in addition to standard of care chemotherapy and Study Treatment Arm B will only receive standard of care chemotherapy. Some procedures involved with the study include genetic testing, physical exams, tumor assessments such as MRIs and CTs, and blood draws.