Hesham Hassan, James Schwab  , Jie Zhang 

Atmospheric Sciences Research Center, University at Albany, Albany, NY, USA

Received: April 3, 2023
Revised: July 26, 2023
Accepted: August 2, 2023

 Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.

Download Citation: ||https://doi.org/10.4209/aaqr.230077  

Cite this article:

Hassan, H., Schwab, J., Zhang, J. (2023). Harmonization of the Long-term PM2.5 Carbon Data from the CSN Sites in New York State. Aerosol Air Qual. Res. 23, 230077. https://doi.org/10.4209/aaqr.230077


  • OC adjustment is location independent.
  • EC adjustment is more difficult particularly at rural sites.
  • Field blanks, outlier filter, and regression used in harmonization.
  • Harmonization method used is applied to NYS CSN sites, other CSN sites needs testing.


Harmonizing the particulate carbon data from the Chemical Speciation Network (CSN) is necessary to perform reliable long-term trend and seasonal variability analyses, clean air regulation assessments, and climate change studies. But it is challenging because the measurement of the carbonaceous fraction of PM2.5 (particulate matter with a diameter less than or equal to 2.5 µm) underwent several changes both in samplers and analysis protocols. To address the above issue, field blanks are used to remove artifacts from samples, an outlier filter is applied to remove anomalies from the dataset, and a regression between retired samplers and the current sampler data is used to establish the harmonization between two co-located urban sites in this study. A second comparison between the retired method and Interagency Monitoring of Protected Visual Environments (IMPROVE) network data was carried out at two sites (one urban and one rural) with co-located samplers. These results show no site dependence for organic carbon (OC) concentrations and small but non-negligible differences for elemental carbon (EC), which can be attributed to the relatively greater uncertainty of the low concentration rural EC measurements. An adjustment criterion that harmonizes the data from the beginning of the sampling period to the present is obtained. The harmonized data shows consistent trends and seasonal variability when compared to the reported data with these trends declining over the period 2001–2018.

Keywords: Particulate carbon, PM2.5, CSN, Organic carbon, Elemental carbon


To better understand the influence of the chemical composition of fine particulate matter (PM2.5), the Chemical Speciation Network (CSN) was first established in 2000 (EPA, 2003; Schwab et al., 2004), with the ability to measure the PM2.5 total mass concentration, numerous trace elements, major inorganic ions (sulphate, nitrate, ammonium, and more), and carbonaceous components (Organic Carbon (OC), and Elemental Carbon (EC)) (EPA, 2014). However, the complex chemical/physical properties of the PM2.5 carbonaceous components limited the precise quantification of their mass concentrations (Malm et al., 2011; Rattigan et al., 2016).

The CSN system in New York State (NYS) started in 2001 with the Rupprecht and Patashnick Co., Inc. Partisol Model 2300 speciation samplers (R&P) (Solomon et al., 2003, 2014; Rattigan et al., 2011), and then shifted to the MetOne Spiral Aerosol Speciation Sampler (MetOne) between 2006 and 2007 (Rattigan et al., 2011), which was further replaced for carbonaceous species only by the URG-3000N sequential particulate speciation system (URG) during 2007–2009 to present. Particulate carbon samplers collect samples on quartz fiber filters which are analyzed using thermal/optical methods. The general sampler design and analysis methods can be found elsewhere in the literature (e.g., Macias and Hopke, 1981; Chow et al., 1993; Birch and Cary, 1996).

For filter analysis, URG and IMPROVE samples use the IMPROVE_A thermal/optical reflectance (TOR) protocol to analyze filters and obtain OC and EC, while R&P and MetOne used the National Institute of Occupational Safety and Health (NIOSH) thermal/optical transmittance (TOT) protocol (Chow et al., 2007; Wu et al., 2016). The discrepancies between the instruments (Table S1) and the analysis protocols from R&P and MetOne, to URG, resulted in inconsistencies in the recorded data, which jeopardized the certainty of any research results dependent on this data, given the importance of particulate carbon (organic and elemental) for environment (e.g., visibility), health impacts (e.g., cardiovascular and respiratory diseases), and climate (e.g., direct and indirect effects) (Hand et al., 2012).

The CSN network was well maintained in NYS during the past two decades, with the overlapping of the above instruments during some periods and the overlapping of the CSN and IMPROVE at a few sites, which provide a unique chance to harmonize the different datasets from different instruments based on different protocols, into a continuous long-term dataset. This will benefit both researchers and policymakers.

Malm et al. (2011) and Hand et al. (2012) performed a similar study that scaled CSN data to IMPROVE data and compared them, respectively. The advantage of their studies was that they used a larger number of sites than used in this study, and the disadvantage was that they were limited to shorter time periods (between 2005 and 2006 for Malm et al. (2011), and 2005–2008 for Hand et al. (2012)). Also, Malm et al. (2011) compared only MetOne data with IMPROVE data, whereas in this study the comparison includes both R&P and MetOne data.


The location and period of analysis for the CSN sites used in this study are listed in Table 1 with the location map in Fig. S1. The study included four urban sites in New York City (NYC), two mid-size urban sites, one rural site, and one remote site (Table 1). The time period in this study was 2001–2018. The data adjustment was implemented in three steps, including 1) correcting for field blanks, 2) developing and applying outlier filter criterion, and 3) harmonizing TOT analyzed samples to be consistent with TOR samples, as shown in the following sections.

Table 1. The location of CSN sites and the period used in this study.

2.1 Categorizing Field Blanks

One major tool to reduce the biases due to changes in instruments, location, and operational procedure is the proper handling of the blank filter measurements (Dillner et al., 2009), which represent both in-route (shipping) and in-situ (instrument, location, and setup) artifacts (Schwab et al., 2004). The R&P and MetOne samplers had the same filter type, diameter, spot-size, and were analyzed using the same protocol (Watson et al., 2008). They had different sampling average volumes, flow rates, and face velocities (Malm et al., 2011; Rattigan et al., 2016). URG & IMPROVE both use the same type and size filters, and both currently use the same analysis protocol (Table S1). Field blanks reported from all samplers show a consistent temporal and negligible spatial variability per each sampler, indicating stability and consistency of field blanks with respect to adjustment of measured samples.

Comparing blank adjusted to unadjusted data for all sites showed no significant differences in observed trend patterns for the R&P and MetOne samples (Fig. 1). For this reason, field blank  adjustment may affect the value of single measured sample, but not the general behavior of the data. Therefore, using blank filter measurements to adjust carbon data will preserve the data features (Dillner, 2016).

Fig. 1. The seasonal median blank adjusted (blue) and raw (red) OC data from R&P (a, c, and e) and MetOne (b, d, and f) samplers, for selected sites (PSP, WFM, and Queens) (adj: adjusted).Fig. 1. The seasonal median blank adjusted (blue) and raw (red) OC data from R&P (a, c, and e) and MetOne (b, d, and f) samplers, for selected sites (PSP, WFM, and Queens) (adj: adjusted).

2.2 Outlier Filter

Anomalous data could affect any existing trend, it may increase the amplitude of data variability, and alter the trend slope. However, over-removal of anomalies may change variability patterns and/or mask trends. So, it was necessary to establish a criterion for the representativeness of data points with respect to the general stream of data. High outliers only are removed, as very low data does not qualify as outliers using this method. Two measures used are 1) three months running average and 2) three months running standard deviation both calculated for the reported samples. Then any sample that is greater than the sum of the running mean and 3.5 times the running standard deviation is filtered out according to the following expression:

2.3 Harmonizing TOT Samples to TOR

Co-located samplers using different analysis methods (TOR vs. TOT) were shown to have disagreement between OC and EC fractions (Watson et al., 2005; Rattigan et al., 2011; Malm et al., 2011). Samples analyzed using the TOT method tend to report more pyrolytic carbon (PC) and hence more OC than the TOR method (Chow et al., 2015; Squizzato et al., 2018). Co-located samples from both MetOne and URG samplers were available for fourteen months at IS52 and ten months at Queens. URG samplers were analyzed for both TOR and TOT from (2007/2009) until November 2015, which provided ample data to examine the goodness of adjustment criteria by comparing the adjusted pre-URG-TOT analyzed data to URG-TOT analyzed data. Two periods of bi-square robust regression analyses comparing IMPROVE and CSN data are carried out at each of IS52 and PSP sites representing the R&P period and MetOne periods. For these analyses the EC, OC, and TC data have all been filtered using the criterion that 0.5 < (CSN_carbon/IMPROVE_carbon) ratio < 2.0.


3.1 Field Blanks

Field blank seasonal medians (Fig. 2) and seasonal averages (Fig. S2) were examined. It was found that medians are more consistent and statistically stable. The summer season has higher median (OC) field blank values than any other season, which can be attributed to the increase in SOA during summer compared to any other season (Rattigan et al., 2010), but this is not entirely consistent. Blanks are uniformly high for the R&P and MetOne samplers.

Fig. 2. OC field blank seasonal median of all sites (a) R&P, (b) MetOne, and (c) URG samplers.Fig. 2. OC field blank seasonal median of all sites (a) R&P, (b) MetOne, and (c) URG samplers.

OC field blanks retrieved from the URG sampler are much smaller than retired samplers (compare y-axes in Figs. 2(c), 2(b), and 2(a)). This large difference would magnify the error in any study if data were not adjusted correctly. It should be noted that there were some missed or rejected periods of blank measurements, with a detailed description in Table S2. The full set of seasonal median field blank values used for the adjustment are given in Table S3.

3.2 Regression Analyses

The URG-TOT and URG-TOR analyzed data has been regressed; all sites yielded similar results (Fig. S3), with a linear relation as follows:


This consistent relation lent support to the decision to use the co-located data from MetOne-TOT and URG-TOR at IS52 and Queens, and additionally, R&P-TOT and IMPROVE-TOR at IS52 and PSP, as a guideline to adjust all pre-URG data at all NYS sites.

The similarity in the regression results from IS52 and Queens (Figs. S4 and S5) led to the use of a combined single set of equations for EC and OC at the urban sites:


Figs. S6–S9 show the regression analysis results at IS52 and PSP sites during the co-located IMPROVE-Pre_URG periods for both EC and OC. Results show that regressing OC IMPROVE_TOR data versus MetOne_TOT data at IS52 has a slope of 0.62, slightly lower than MetOne_TOT versus URG_TOR slope with the intercept significantly smaller (0.09 compared to 0.27), and a slope of 0.58 with intercept of 0.34 for R&P. The EC regression shows a significant difference in slopes that is consistent across rural and urban sites, suggesting a sampler related systematic difference.

The OC regression analysis for R&P at PSP shows more consistent results with that at IS52 and Queens. Yet, the slope is smaller compared to the IS52 regarding MetOne_TOT data. The results from both sites emphasize that the relationship between OC measured by R&P_TOT and IMPROVE_TOR samplers (and hence URG) doesn’t show significant site dependency, while MetOne reported data show more site dependance. The relationship between EC concentration measured using pre-URG shows more site-to-site variability. Accordingly, the criteria adopted to adjust the pre-URG data is to use the site dependent regression factors as summarized in Table 2.

Table 2. Pre-URG_TOT OC and EC adjustment to URG TOR criteria summary.
3.3 Pre-URG Harmonization

Figs. 3 and 4 show the monthly average of pre-URG_TOT, adjusted to TOR and URG_TOR analyzed samples for EC and OC, respectively, at Queens, PSP, and WFM sites. The adjusted EC concentrations were generally higher than the reported measurements. However, the opposite can be seen with OC concentrations, which matches the fact TOR-analysis tends to measure lower OC and higher EC concentrations than TOT-analysis method.

Fig. 3. The monthly average pre-URG_TOT measured samples (dashed red and blue lines), adjusted to TOR (solid red and blue lines) and URG_TOR measured samples (solid black line) for EC at three selected sites.Fig. 3. The monthly average pre-URG_TOT measured samples (dashed red and blue lines), adjusted to TOR (solid red and blue lines) and URG_TOR measured samples (solid black line) for EC at three selected sites.

Fig. 4. The monthly average pre-URG_TOT measured samples (dashed red and blue lines), adjusted to TOR (solid red and blue lines) and URG_TOR measured samples (solid black line) for OC at three selected sites.Fig. 4. The monthly average pre-URG_TOT measured samples (dashed red and blue lines), adjusted to TOR (solid red and blue lines) and URG_TOR measured samples (solid black line) for OC at three selected sites.

The adjusted values track the reported values, and the difference between reported and adjusted concentrations is proportional to the reported concentrations. Moreover, Mann-Kendall trend significance analysis showed no significant differences between reported and adjusted pre-URG data, Table S4 shows the results of Mann-Kendall trend significance analysis for adjusted EC and OC data. In the case of a non-adjusted dataset, Fig. 4 shows an unrealistic declining trend for OC during the transition from pre-URG to URG sampling. These features of the adjustment method (tracking over the break in sampler and analysis method change and proportionality of deficit to the reported data) preserve the trend and variability of the dataset and guarantee no systematic bias.

Although the adjusted pre-URG data preserves the same trends as the originally reported data, one important add on to the data is that for EC, analyzing the un-adjusted data with the URG data at the same time will mask or reverse the trend direction (lower reported EC data). On the other hand, OC reported data which is higher than the adjusted data will unrealistically magnify the trend. Moreover, with adjusted OC data we can figure out that there is no statistically significant trend at WFM (specifically since 2008), which can’t be assessed using only reported unadjusted data.

To keep the harmonized dataset as consistent as possible and given that URG became the longest in use sampler, whenever there are co-located data, URG data is used. The full harmonized EC, OC, and TC data annual averages can be found in Fig. 5 which show a statistically significant declining trend (except for WFM OC and TC), in agreement with other studies (Rattigan et al., 2016; Blanchard et al., 2021).

Fig. 5. Harmonized PM2.5 Carbonaceous component annual averages at different NYS sites for (a) EC, (b) OC, and (c) TC.Fig. 5. Harmonized PM2.5 Carbonaceous component annual averages at different NYS sites for (a) EC, (b) OC, and (c) TC.


A method to adjust the particulate carbon data from retired samplers to match the current samplers is provided to help facilitate and enhance the long-term trends, seasonal variability, source apportionment, regulation assessments, and climate change studies. In this study, artifacts were removed from samples using the field blanks and anomalies were removed using an outlier filter. Several regression analyses were used to harmonize the CSN carbon data with the URG. The relationship between TOT-analyzed and TOR-analyzed samples doesn’t show significant environmental dependence for OC, while EC samples show higher uncertainty. The resultant harmonized dataset was found to preserve the main features of the reported data which shows declining trends. More details about long-term trends and seasonal variability are the subject of a future study.


Support from NYSERDA contract 48971 is gratefully acknowledged. The authors also acknowledge useful discussions with Dr. Oliver Rattigan at NYSDEC.


  1. Birch, M.E., Cary, R.A. (1996). Elemental carbon-based method for monitoring occupational exposures to particulate diesel exhaust. Aerosol Sci. Technol. 25, 221–241. https://doi.org/​10.1080/02786829608965393

  2. Blanchard, C.L., Shaw, S.L., Edgerton, E.S., Schwab, J.J. (2021). Ambient PM2.5 organic and elemental carbon in New York City: Changing source contributions during a decade of large emission reductions. J. Air Waste Manage. Assoc. 71, 995–1012. https://doi.org/10.1080/​10962247.2021.1914773

  3. Chow, J.C., Watson, J.G., Pritchett, L.C., Pierson, W.R., Frazier, C.A., Purcell, R.G. (1993). The DRI thermal/optical reflectance carbon analysis system: description, evaluation and applications in US air quality studies. Atmos. Environ. 27, 1185–1201. https://doi.org/10.1016/0960-1686(93)90245-T

  4. Chow, J.C., Watson, J.G., Chen, L.W.A., Chang, M.C.O., Robinson, N.F., Trimble, D., Kohl, S. (2007). The IMPROVE_A temperature protocol for thermal/ optical carbon analysis: Maintaining consistency with a long-term database. J. Air Waste Manage. Assoc. 57, 1014–1023. https://doi.org/10.3155/1047-3289.57.9.1014

  5. Chow, J.C., Lowenthal, D.H., Chen, L.W.A., Wang, X., Watson, J.G. (2015). Mass reconstruction methods for PM2.5: a review. Air Qual. Atmos. Health 8, 243–263. https://doi.org/10.1007/​s11869-015-0338-3

  6. Dillner, A.M., Phuah, C.H., Turner, J.R. (2009). Effects of post-sampling conditions on ambient carbon aerosol filter measurements. Atmos. Environ. 43, 5937–5943. https://doi.org/10.1016/​j.atmosenv.2009.08.009

  7. Dillner, A.M. (2016). Recent Changes to the IMPROVE and CSN Organic Carbon Artifact Adjustment Method. NAAMC, August 10, 2016. (accessed 25 January 2023).

  8. Environmental Protection Agency (EPA) (2003). Applicability of the Safe Drinking Water Act to Submetered Properties Docket: OW-2003-0065. Federal Register. 68 FR 74233, pp. 74233–74235. (accessed 13 March 2023).

  9. Environmental Protection Agency (EPA) (2014). CSN Network Assessment. (accessed 01/25/2023).

  10. Hand, J.L., Schichtel, B.A., Pitchford, M., Malm, W.C., Frank, N.H. (2012). Seasonal composition of remote and urban fine particulate matter in the United States. J. Geophys. Res. 117, D05209. https://doi.org/10.1029/2011JD017122

  11. Macias, E.S., Hopke, P.K. (Eds.) (1981). Atmospheric aerosol: source/air quality relationships. American Chemical Society, Washington, D.C. https://doi.org/10.1021/bk-1981-0167

  12. Malm, W.C. (2004). Spatial and monthly trends in speciated fine particle concentration in the United States. J. Geophys. Res. 109, D03306. https://doi.org/10.1029/2003JD003739

  13. Malm, W.C., Schichtel, B.A., Pitchford, M.L. (2011). Uncertainties in PM2.5 gravimetric and speciation measurements and what we can learn from them. J. Air Waste Manage. Assoc. 61, 1131–1149. https://doi.org/10.1080/10473289.2011.603998

  14. Rattigan, O.V., Felton, H.D., Bae, M.S., Schwab, J.J., Demerjian, K.L. (2010). Multi-year hourly PM2.5 carbon measurements in New York: Diurnal, day of week and seasonal patterns. Atmos. Environ. 44, 2043–2053. https://doi.org/10.1016/j.atmosenv.2010.01.019

  15. Rattigan, O.V., Felton, H.D., Bae, M.S., Schwab, J.J., Demerjian, K.L. (2011). Comparison of long-term PM2.5 carbon measurements at an urban and rural location in New York. Atmos. Environ. 45, 3228–3236. https://doi.org/10.1016/j.atmosenv.2011.03.048

  16. Rattigan, O.V., Civerolo, K.L., Dirk Felton, H., Schwab, J.J., Demerjian, K.L. (2016). Long term trends in New York: PM2.5 mass and particle components. Aerosol Air Qual. Res. 16, 1191–1205. https://doi.org/10.4209/aaqr.2015.05.0319

  17. Schwab, J.J., Felton, H.D., Demerjian, K.L. (2004). Aerosol chemical composition in New York state from integrated filter samples: Urban/rural and seasonal contrasts. J. Geophys. Res. 109, D16S05. https://doi.org/10.1029/2003JD004078

  18. Solomon, P., Baumann, K., Edgerton, E., Tanner, R., Eatough, D.J., Modey, W., Maring, H., Savoie D., Natarajan, S., Meyer, M., Norris, G. (2003). Comparison of integrated samplers for mass and composition during the 1999 Atlanta Supersites project. J. Geophys. Res. 108, 8423. https://doi.org/10.1029/2001JD001218

  19. Solomon, P.A., Crumpler, D., Flanagan, J.B., Jayanty, R.K.M., Rickman, E.E., McDade, C.E. (2014). U.S. national PM2.5 chemical speciation monitoring networks-CSN and IMPROVE: description of networks. J. Air Waste Manage. Assoc. 64, 1410–1438. https://doi.org/10.1080/10962247.​2014.956904

  20. Squizzato, S., Masiol, M., Rich, D.Q., Hopke, P.K. (2018). A long-term source apportionment of PM2.5 in New York State during 2005–2016. Atmos. Environ. 192, 35–47. https://doi.org/​10.1016/j.atmosenv.2018.08.044

  21. Watson, J.G., Chow, J.C., Chen, L.W.A. (2005). Summary of organic and elemental carbon/black carbon analysis methods and intercomparisons. Aerosol Air Qual. Res. 5, 65–102. https://doi.org/​10.4209/aaqr.2005.06.0006

  22. Watson, J.G., Chow, J.C., Chen, L.W.A., Kohl, S.D., Tropp, R.J., Trimble, D., Chancellor, S., Sodeman, D., Ozgem, S., Frank, N. (2008). Assessment of carbon sampling artifacts in the IMPROVE, STN/CSN, and SEARCH networks. Division of Atmospheric Sciences, Desert Research Institute, USA.

  23. Wu, C., Huang, X.H., Ng, W.M., Griffith, S.M., Yu, J.Z. (2016). Inter-comparison of NIOSH and IMPROVE protocols for OC and EC determination: implications for inter-protocol data conversion. Atmos. Meas. Tech. 9, 4547–4560. https://doi.org/10.5194/amt-9-4547-2016 

Share this article with your colleagues 


Subscribe to our Newsletter 

Aerosol and Air Quality Research has published over 2,000 peer-reviewed articles. Enter your email address to receive latest updates and research articles to your inbox every second week.

77st percentile
Powered by
   SCImago Journal & Country Rank

2022 Impact Factor: 4.0
5-Year Impact Factor: 3.4

The Future Environment and Role of Multiple Air Pollutants

Aerosol and Air Quality Research partners with Publons

CLOCKSS system has permission to ingest, preserve, and serve this Archival Unit
CLOCKSS system has permission to ingest, preserve, and serve this Archival Unit

Aerosol and Air Quality Research (AAQR) is an independently-run non-profit journal that promotes submissions of high-quality research and strives to be one of the leading aerosol and air quality open-access journals in the world. We use cookies on this website to personalize content to improve your user experience and analyze our traffic. By using this site you agree to its use of cookies.