Objective Elevated serum IgG4 levels are an important hallmark for diagnosing IgG4-related disease (IgG4-RD), but can also be observed in other diseases. This study aimed to compare two different testing methods for IgG4: ELISA and nephelometric assay. Both assays were used to measure serum IgG4 concentrations, and to assess the prevalence of high serum IgG4 levels in both IgG4-RD and non-IgG4-RD diseases. Methods A total of 80 serum samples were tested using the nephelometric assay and ELISA method that we established. Serum IgG4 concentrations were determined by ELISA for 957 patients with distinct diseases, including 12 cases of IgG4-RD and 945 cases of non-IgG4-RD. Results IgG4 levels from 80 selected serum samples examined by ELISA were in agreement with those detected using the nephelometry assay. Meanwhile, the serum IgG4 concentrations measured by ELISA were also consistent with the clinical diagnoses of patients with IgG4-RD during the course of disease. The Elevated levels of serum IgG4 (>1.35 g/L) were detected in all IgG4-RD (12/12) patients, and the prevalence of high IgG4 serum levels was 3.39% in non-IgG4-RD cases. Among them, the positive rates of serum IgG4 were 2.06% in patients with carcinoma and 6.3% in patients with other non-IgG4 autoimmune diseases. Conclusion Our established ELISA method is a reliable and convenient technique, which could be extensively used in the clinic to measure serum IgG4 levels. High levels of IgG4 were observed in IgG4-RD. However, this phenomenon could also be observed in other diseases, such as carcinomas and other autoimmune diseases. Thus, a diagnosis of IgG4 disease cannot only be dependent on the detection of elevated serum IgG4 levels.