Glembatumumab Vedotin, Nivolumab, and Ipilimumab in Treating Patients With Advanced Metastatic Solid Tumors That Cannot Be Removed by Surgery

Patients who have had systemic therapy within 2 weeks (6 weeks for nitrosoureas or mitomycin C) or radiotherapy within 2 weeks prior to entering the study

Patients who have not recovered from adverse events due to prior anti-cancer therapy (i.e., have residual toxicities \>= grade 2 other than alopecia)

Patients who are receiving any other concurrent investigational agents; those with history of receiving investigational cancer treatment are allowed as long as washout period is fulfilled

Symptomatic or untreated leptomeningeal or brain metastases or spinal cord compression; patients with treated and stable brain metastases will be allowed; controlled brain metastases are defined as no radiographic progression for at least 4 weeks following radiation and/or surgical treatment (or 4 weeks of observation if no intervention is clinically indicated), and off of steroids for at least 2 weeks, and no new or progressive neurological signs and symptoms

History of allergic reactions attributed to compounds of similar chemical or biologic composition to nivolumab, glembatumumab vedotin, or other agents used in study; this includes sensitivity to the drugs dolastatin or auristatin

History of severe hypersensitivity reaction to any monoclonal antibody

Uncontrolled intercurrent illness including, but not limited to, ongoing or active infection, symptomatic congestive heart failure, unstable angina pectoris, cardiac arrhythmia, or psychiatric illness/social situations that would limit compliance with study requirements

Participants must not have a history of life-threatening toxicity related to prior IO treatment (eg, anti-CTLA-4 or anti-PD-1/PD-L1 treatment or any other antibody or treatment specifically targeting T-cell co-stimulation or immune checkpoint pathways); i) participants with toxicities that are unlikely to recur with standard countermeasures (eg, hormone replacement treatment after adrenal crisis) are eligible

Pregnant women are excluded from this study; breastfeeding should be discontinued if the mother is treated with nivolumab and glembatumumab vedotin

Human immunodeficiency virus (HIV) patients should be allowed if otherwise eligible, with the following caveats:

* Undetectable HIV viral load by standard clinical assay

* Willing to remain adherent with antiretroviral therapy that has minimal overlapping toxicity or pharmacokinetic interactions with protocol therapy

* CD4+ T cell counts of 200/mm\^3 or greater

* No acquired immunodeficiency syndrome (AIDS)-defining events other within the past 12 months

* Near normal life expectancy if not for presence of the cancer

* Not taking antiviral agents that are otherwise prohibited because of CYP interactions

Patients should be excluded if they have a positive test for hepatitis B virus surface antigen (HBV sAg) or hepatitis C virus ribonucleic acid (HCV RNA) indicating acute or chronic infection

Patients with active autoimmune disease or history of autoimmune disease that might recur, which may affect vital organ function or require immune suppressive treatment including systemic corticosteroids, should be excluded; these include but are not limited to patients with a history of immune related neurologic disease, multiple sclerosis, autoimmune (demyelinating) neuropathy, Guillain-Barre syndrome, myasthenia gravis; systemic autoimmune disease such as systemic lupus erythematosus (SLE), connective tissue diseases, scleroderma, inflammatory bowel disease (IBD), Crohn's, ulcerative colitis, hepatitis; and patients with a history of toxic epidermal necrolysis (TEN), Stevens-Johnson syndrome, or phospholipid syndrome should be excluded because of the risk of recurrence or exacerbation of disease; patients with vitiligo, endocrine deficiencies including thyroiditis managed with replacement hormones including physiologic corticosteroids are eligible; patients with rheumatoid arthritis and other arthropathies, Sjogren's syndrome and psoriasis controlled with topical medication and patients with positive serology, such as antinuclear antibodies (ANA), anti-thyroid antibodies should be evaluated for the presence of target organ involvement and potential need for systemic treatment but should otherwise be eligible

Patients are permitted to enroll if they have vitiligo, type I diabetes mellitus, residual hypothyroidism due to autoimmune condition only requiring hormone replacement, psoriasis not requiring systemic treatment, or conditions not expected to recur in the absence of an external trigger (precipitating event)

Patients should be excluded if they have a condition requiring systemic treatment with either corticosteroids (\> 10 mg daily prednisone equivalents) or other immunosuppressive medications within 14 days of study drug administration; inhaled or topical steroids and adrenal replacement doses =\< 10 mg daily prednisone equivalents are permitted in the absence of active autoimmune disease; patients are permitted to use topical, ocular, intra-articular, intranasal, and inhalational corticosteroids (with minimal systemic absorption); physiologic replacement doses of systemic corticosteroids are permitted, even if =\< 10 mg/day prednisone equivalents; a brief course of corticosteroids for prophylaxis (e.g., contrast dye allergy) or for treatment of non-autoimmune conditions (e.g., delayed-type hypersensitivity reaction caused by contact allergen) is permitted

Patients who have had evidence of active or acute diverticulitis, intra-abdominal abscess, gastrointestinal (GI) obstruction and abdominal carcinomatosis which are known risk factors for bowel perforation should be evaluated for the potential need for additional treatment before coming on study

Use of any vaccines against infectious diseases (e.g. influenza, varicella, pneumococcus) within 4 weeks of initiation of study treatment

What this study is about