Pembrolizumab With Combination Chemotherapy in Treating Participants With Locally Advanced or Metastatic Small Cell/Neuroendocrine Cancers of Urothelium or Prostate

Has disease suitable for local treatment with curative intent.

A WOCBP who has a positive urine pregnancy test within 72 hours prior to receiving the first dose of trial medication. If the urine test is positive or cannot be confirmed as negative, a serum pregnancy test will be required.

Has received prior therapy with an anti-PD-1, anti-PD-L1, or anti-PD-L2 agent or with an agent directed to another stimulatory or co-inhibitory T-cell receptor (e.g. CTLA-4, OX-40, CD137).

Has received prior systemic anti-cancer therapy including investigational agents within 4 weeks prior to first dose of trial treatment.

* Note: Participants must have recovered from all AEs due to previous therapies to =\< grade 1 or baseline. Participants with =\< grade 2 neuropathy may be eligible.

* Note: If participant received major surgery, they must have recovered adequately from the toxicity and/or complications from the intervention prior to starting study treatment.

Has received prior radiotherapy within 2 weeks of start of study treatment. Participants must have recovered from all radiation-related toxicities, not require corticosteroids, and not have had radiation pneumonitis. A 1-week washout is permitted for palliative radiation (=\< 2 weeks of radiotherapy) to non-central nervous system (CNS) disease.

Has received a live vaccine within 30 days prior to the first dose of study drug. Examples of live vaccines include, but are not limited to, the following: measles, mumps, rubella, varicella/zoster (chicken pox), yellow fever, rabies, Bacillus Calmette?Guerin (BCG), and typhoid vaccine. Seasonal influenza vaccines for injection are generally killed virus vaccines and are allowed; however, intranasal influenza vaccines (eg, FluMist) are live attenuated vaccines and are not allowed.

Is currently participating in or has participated in a study of an investigational agent or has used an investigational device within 4 weeks prior to the first dose of study treatment.

* Note: Participants who have entered the follow-up phase of an investigational study may participate as long as it has been 4 weeks after the last dose of the previous investigational agent.

Has a diagnosis of immunodeficiency or is receiving chronic systemic steroid therapy (in dosing exceeding 10 mg daily of prednisone equivalent) or any other form of immunosuppressive therapy within 7 days prior to the first dose of study drug.

Has a known additional malignancy that is progressing or has required active treatment within the past 3 years. Note: Participants with basal cell carcinoma of the skin, squamous cell carcinoma of the skin, or carcinoma in situ (e.g. breast carcinoma, cervical cancer in situ) that have undergone potentially curative therapy are not excluded.

* For Cohort 1, a history of prostate cancer that was identified incidentally following cystoprostatectomy for bladder cancer is acceptable provided that the PSA is \< 0.2.

Has known active CNS metastases and/or carcinomatous meningitis. Participants with previously treated brain metastases may participate provided they are radiologically stable, i.e. without evidence of progression for at least 4 weeks by repeat imaging (note that the repeat imaging should be performed during study screening), clinically stable and without requirement of steroid treatment for at least 14 days prior to first dose of study treatment.

Has severe hypersensitivity (\>= grade 3) to pembrolizumab and/or any of its excipients.

Has active autoimmune disease that has required systemic treatment in the past 2 years (i.e. with use of disease modifying agents, corticosteroids or immunosuppressive drugs). Replacement therapy (eg., thyroxine, insulin, or physiologic corticosteroid replacement therapy for adrenal or pituitary insufficiency, etc.) is not considered a form of systemic treatment.

Has a history of (non-infectious) pneumonitis that required steroids or has current pneumonitis.

Has an active infection requiring systemic therapy.

Has a known history of human immunodeficiency virus (HIV).

Has a known history of hepatitis B (defined as hepatitis B surface antigen \[HBsAg\] reactive) or known active hepatitis C virus (defined as HCV ribonucleic acid \[RNA\] \[qualitative\] is detected) infection. Note: no testing for hepatitis B and hepatitis C is required unless mandated by local health authority.

Has a known history of active TB (bacillus tuberculosis).

Has a history or current evidence of any condition, therapy, or laboratory abnormality that might confound the results of the study, interfere with the subject?s participation for the full duration of the study, or is not in the best interest of the subject to participate, in the opinion of the treating investigator.

Has known psychiatric or substance abuse disorders that would interfere with cooperation with the requirements of the trial.

Is pregnant or breastfeeding, or expecting to conceive or father children within the projected duration of the study, starting with the screening visit through 120 days after the last dose of trial treatment.

What this study is about