- Email: [email protected]
Opinion of the food processors, wholesale and retail companies towards the Program for Product Quality Analysis in São Paulo, Brazil
Food Control 14 (2003) 545–551 www.elsevier.com/locate/foodcont
Opinion of the food processors, wholesale and retail companies towards the Program for Product Quality Analysis in S~ao Paulo, Brazil K atia Cilene Tabai, Elisabete Salay
*
DEPAN FEA UNICAMP, Caixa Postal 6121, 13083-970 Campinas, S~ ao Paulo, Brazil Received 27 March 2002; received in revised form 14 September 2002; accepted 16 September 2002
Abstract This research seeks to identify the opinion of food manufacturing, wholesale and retail companies towards the Program for Product Quality Analysis in Brazil. Managers from 11 food manufacturing companies and six wholesalers and retailers from the State of S~ao Paulo were interviewed. The results showed that there is a lack of knowledge of the official methodology adopted by the program. The food processors were concerned about the impact the divulging of the results of these analyses would have on the wholesalers and retailers. In addition, they contested the way in which the results were divulged. However the majority of the interviewees believed that the general effect of the program on the society was positive. Ó 2003 Elsevier Ltd. All rights reserved. Keywords: Food safety; Food control; Quality; Brazil
1. Introduction Progress in the food technology area has not impeded the occurrence of food poisoning outbreaks, which affect considerable proportions of populations in various countries. In the USA, one of the largest food producers in the world, it is estimated that each year approximately 9000 deaths and between 6.5 and 33 million cases of disease directly related to food borne pathogens occur. 1; 2 In Brazil there are various cases of microbiological food contamination. However, official data describing the presence of microbiological food poisoning is not systematically divulged (Salay, Pereira, Mercadante, Netto, & Cavalli, 2001). The Ministry of Health and the Ministry of Agriculture, Food and Supply are the organs responsible for food legislation in Brazil. On the other hand, the National Institute of Metrology, Normalization and
*
Corresponding author. Fax: +55-19-3788-4059. E-mail address: [email protected] (E. Salay). 1 Information obtained in a site about food safety (Partnership for food safety education, 1998). 2 Food borne disease is considered as: ‘‘a disease of a normally toxic or infectious nature caused by agents entering the body via food ingestion’’ (WHO, 1984). 0956-7135/$ - see front matter Ó 2003 Elsevier Ltd. All rights reserved. doi:10.1016/S0956-7135(02)00118-4
Industrial Quality––INMETRO, with the collaboration of the State Institute of Weights and Measures––IPEM, analyze the adequacy of the products to the criteria established by the Brazilian legislation with respect to volume, weight and form of packaging. INMETRO also participates in the coordination of the ‘‘Strategic Project for the Consciousness and Education of Consumers and Users’’, one of the projects of the Brazilian Program for Quality and Productivity, developed by the Federal Government. With the objective of better informing the consumer, in 1996 the Institute created the Strategic Project ‘‘Education for Consumption’’, which is composed of two programs: The Program for Product Quality Analysis and the Program for the Education of Consumers. The Program for Product Quality Analysis evaluates quality conformity of diverse products, including those of food origin. It then divulges the results aiming at informing the consumer. Similar programs have been developed in various different countries, such as the United States of America, France, Germany, Spain and Holland (Guilford, 1993; Liporace, 1996). However, evaluations of the results of these actions are scarce. The present survey aims at analyzing the opinion of the private sector on the effects of the Program for Product Quality Analysis developed by INMETRO in food
546
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
industries and commercial establishments based in the State of S~ ao Paulo, Brazil.
2. Methods This survey used a program evaluation approach to identify and analyze the effects of the Program for Product Quality Analysis on the food companies. According to Cohen and Franco (1988), the type of program evaluation depends on the specific nature and objectives of each study. In this way the authors observed that it is by way of an evaluation of programs that one manages to obtain information on the impact of policies, allowing for the reorganization of the actions in order to attain the proposed goals and objectives. The Program for Product Quality Analysis carries out the analyses of product conformity with the norms or technical regulations. For this it adopts a series of procedures described in INMETRO (1999). Prominent amongst these procedures is the fact that the Institute uses market research to select the products to be analyzed. The tests are carried out by certified laboratories or those recognized by the Government Inspection Network. Buying of the samples is carried out emphasizing questions related to the integrity of the packages, the observation of shelf life deadlines and the conditions of preservation, handling, storage and transport. The results are first divulged to the manufacturer of the products analyzed, establishing a period of five working days for their manifestation. Documents registering results which could compromise public health are subsequently sent to the organs responsible for regulation and inspection and also to those entities representing the manufacturers, without identification of the brands and their respective manufacturers. Finally the results are divulged to the press and other interested organs. 2.1. Survey design The period studied in this survey was that between the implantation of the Program for Product Quality Analysis (1996) until 1999. It was considered that a period of four years would be representative for the analysis of the results of the program as applied to food companies. In fact, by way of the Program for Product Quality Analysis, 59 products of food origin, involving 567 manufacturers and 638 brands, were evaluated during these four years. Of the companies involved, about 100 had their administrative headquarters in the State of S~ ao Paulo and had their products analyzed between 1996 and 1999. Contact was made with all these companies (N ¼ 100), but only 11 designated technicians for interviews. After carrying out these interviews, the need to also check the opinion of wholesalers and retailers about the Program
for Product Quality Analysis became apparent. All the available commercial outlets in the City of Campinas, State of S~ao Paulo, approximately 30 establishments, whose units were represented by a volume of sales in other parts of the country considered large, were contacted. It was possible to interview two commercial wholesalers and four commercial retailers. Considering that these establishments commercialized an important volume of food in the country, it was accepted that they could offer significant data on the opinion of the companies with respect to the effects of the program. The food industries and commercial wholesalers and retailers visited were catalogued and numbered based on the industrialized products analyzed in the case of the industries, and the respective categories in the case of the commercial establishments. Thus for companies nos. 1 and 2, hearts of palm in conserve were analyzed; for company no. 3, refined salt was analyzed; for company no. 4, three products were analyzed––milk, crackers and spaghetti; for company no. 5, coffee was the object of study; for no. 6 only milk quality was examined; whereas company no. 7, in addition to milk, fresh Minas type cheese was examined; for company no. 8, tea was the object of analysis; for industry no. 9 vinegar and hearts of palm in conserve were analyzed; and for company no. 10, the qualities of margarine, tomato extract and olive oil were examined; for no. 11, ‘‘prato’’ and fresh type cheeses were examined and also powdered, UHT and flavored milks; and companies nos. 12 and 13 were the commercial wholesalers visited and nos. 14–17 the commercial retailers visited, all in the Campinas area. 3 From January to July 2000, interviews were carried out with the firm managers and with the technician responsible for the Program for Product Quality Analysis subject in the Brazilian Association of Food Processors ABIA, 4 using structured and semi-structured questions. The data obtained by way of interviews was systematized and the analyses presented are descriptive. 2.2. Indicators Considering the objectives of the evaluation proposed, that is, to identify the results of the Program for Product Quality Analysis in the companies, some indi3 Numbers were used for the above mentioned companies instead of their names, which were not cited to preserve the sources of information considered in this survey. 4 ABIA represents the Brazilian food processors in the institutional forums, defending their interests. The Association acts together with its approximately 2000 associates, which are the food industries and connected companies (such as, for example, the food packaging companies), Federal, State and Municipal authorities, international organs, universities, research institutes and professional individuals in the food area (ABIA, 2000).
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
cators were defined for this analysis. Taking into consideration the unprecedented character of the current survey, it was decided to use qualitative data to represent the opinion of the business sector with respect to the program. In addition, the individuals expressed their opinion using a dual (yes and no) or a three point scale (for example: great effect, medium effect or small effect) for some indicators. The indicators used are related below. 2.3. ABIA 1. Opinion of ABIA with respect to Program for Product Quality Analysis; 2. Actions of ABIA with respect to Program for Product Quality Analysis. 2.4. Food processors, wholesalers and retailers 1. Knowledge of the companies about the Program for Product Quality Analysis of INMETRO and the methodology adopted in the Program for Product Quality Analysis; 2. View of the companies with respect to the divulging of results by the televised press; 3. General effect of the analyses on the companies; 4. Effect on the consciousness of the consumers/buyers; 5. Repercussion to the actions of the inspection organs; 6. Impact of the divulging of the results on product sales; 7. Program as collaborator for the improvement of food product quality; 8. Irregularities identified in the analysis of food products; 9. Consequences of the divulging of the results of the tests for the food industries on the consumer market; 10. Procedures adopted by the food industries as a result of the divulging of the Program for Product Quality Analysis results; 11. Criticism of the methodologies adopted in the Program for Product Quality Analysis and divulged in the press.
3. Results 3.1. View of the ABIA In the opinion of ABIA, the Program for Product Quality Analysis affects the whole food sector, and not just the food manufacturers. According to the association, the Brazilian consumers are now more aware of their rights, and INMETRO has contributed to this by way of the Program for Product Quality Analysis. ABIA considers this program to be important, since they be-
547
lieve that in many cases, inspection by the competent organs is precarious in Brazil. The association considers the effects of the Program for Product Quality Analysis to be positive for the companies, so long as the irregularities shown by the analyses are real and correct. In the view of the Association, divulging by the televised press is important, but not in the case of small irregularities, which do not reflect in risks to the consumer. ABIA questions some of the methods used for product quality analysis by the laboratories and is in favor of changing the sampling criteria, believing that the choice of products for these analyses should be more representative. With respect to the Program for Product Quality Analysis, ABIA acts for both INMETRO and the companies, being consulted by INMETRO about technologies, laboratories and updating of the legislation, amongst other items. With respect to the companies, the Association gives technical and legal support as necessary, for example, when the result of the quality analysis of a product presents a product composition different to that stated on the label. The food processors have a given period to reply after receiving the results of the analyses, and, depending on these, the company can take legal action, and INMETRO accept the action.
3.2. Effects of program for product quality analysis on food processors, wholesalers and retailers 3.2.1. Knowledge by the companies about the program for product quality analysis Table 1 shows that all the manufacturers visited acknowledged knowing about the Program for Product Quality Analysis, since their products had been analyzed. On the other hand, they affirmed they did not officially know which methodology had been adopted by the institute. For the representatives of the wholesale companies interviewed, their knowledge of the Program for Product Quality Analysis was limited to what was transmitted by the press. With respect to the representatives of the retailers interviewed, they were divided between those with limited knowledge and those who only knew what was transmitted by the press, plus the fact of having no knowledge of the methodology used. The food manufacturers emphasized that the people have a right to access this type of information. Based on the group of industries visited, it can be seen that 65% of those interviewed considered the procedure established by INMETRO with respect to the divulging by the press, as a positive aspect (Table 1). However the individuals observed that the way in which the press had done this divulging could be improved. The company recognizes the importance of the Program for Product Quality Analysis, although one can also observe the
548
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
Table 1 The program for product quality analysis for products of food origin of the National Institute of Metrology and Industrial Quality––INMETRO: description of the effects on the food processors and commerce of the State of S~ao Paulo, 2000 Effects of the Program for Product Quality Analysis of INMETRO
Processors
Wholesalers %
N
%
Knowledge of the company about the Program for Product Quality Analysis Yes 11 100.0 No 0 0.0
2 0
100.0 0.0
4 0
100.0 0.0
Knowledge of the methodology of Program for Product Quality Analysis Yes 0 0.0 No (except that transmitted by the media) 11 100.0
0 2
0.0 100.0
2 2
50.0 50.0
View of the divulging by the press Positive Negative No opinion
7 2 2
63.6 18.2 18.2
2 0 0
100.0 0.0 0.0
2 1 1
50.0 25.0 25.0
General effect of the analyses on the companies Positive Negative No effect
8 2 1
72.7 18.2 9.1
1 1 0
50.0 50.0 0.0
3 1 0
75.0 25.0 0.0
Consciousness of consumers/buyers Greater Lesser No effect
6 3 2
54.5 27.3 18.2
1 1 0
50.0 50.0 0.0
4 0 0
100.0 0.0 0.0
Repercussion in the Inspection organs Great Medium Small
4 3 4
36.4 27.2 36.4
2 0 0
100.0 0.0 0.0
0 0 4
0.0 0.0 100.0
Impact on product sales Positive Negative No effect
2 6 3
18.2 54.5 27.3
2 0 0
100.0 0.0 0.0
3 0 1
75.0 0.0 25.0
63.6 36.4
2 0
100.0 0.0
3 1
75.0 25.0
Program for Product Quality Analysis collaborator of food quality Yes 7 No 4
indignation of some interviewees with respect to the sensationalism of the divulging by the media. Despite the constant criticism during the interviews concerning the methods used to define sampling procedures, when questioned specifically on this point, of all the agents interviewed only one explicit comment was made that the methodology applied was incorrect (Table 2). 3.2.2. View and procedures of the companies with respect to divulging by the televised press Divulging of the analyses by the press is recognized as a positive action by the wholesalers. On the other hand, the retailers were divided on the subject of divulging the results of the analyses by the press, emphasizing that this represents a kind of ‘‘consumer alert’’, but that it is not always done as they believe it should be done, since the press apparently prefers to emphasize the mistakes and not the correct actions. The fear of criticism and slander appear to stimulate reactions of aversion in these professionals.
%
Retailers
N
N
The majority of the food processors alleged having no pre-established position as a response to the consumers after the media divulged their problems. Only two industries admitted concern about this type of action, since they had already organized a Customer Service (Table 2). 3.2.3. General effect of the analyses on the society The majority of the food processors interviewed, about 70%, alleged a general positive effect of the Program for Product Quality Analysis (Table 1). The effects of the Program for Product Quality Analysis analyses tend to show negative repercussions only for those companies in whose products irregularities were detected and divulged, reaching a large contingent of the population. Opinion on the effects of the program for the wholesale network was divided: half of them think it is positive and half think it is negative. The majority (75%) of the retailers interviewed believed that the Program for Product Quality Analysis exerts a generally positive
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
549
Table 2 The Program for Product Quality Analysis for food products, of the National Institute of Metrology and Industrial Quality––INMETRO and the food processors in S~ ao Paulo, Brazil, 2000 Effects of the Program for Product Quality Analysis of INMETRO
Processors N
Irregularities shown by the analyses Yes 3 No 8 Effects of the irregularities detected by the analyses Removed the batchesa 1 None 10 Procedures adopted in virtue of divulging the results Customer Service 2 None 9 Criticism of the Program for Product Quality Analysis methodology divulged by the media Yes 1 No 10 a
% 27.3 72.7 9.1 90.9 18.2 81.8 9.1 90.9
The plant that removed all their batches of commercialized products from the market was located in the State of Rio Grande do Sul.
effect, since the consumers, after being warned by the television program, substitute irregular products with those that conform to quality standards (Table 1). 3.2.4. Consumer/buyer consciousness More than half of the food processors considered that, in general, the consumers show a greater level of consciousness. However they believe that this situation is conditioned by the action of other consumer defense organs and by the whole movement generated by the Brazilian Consumer Defense Code, which came into effect in 1991. The companies recognize that other organizations are acting in favor of the consumer and that INMETRO is just one more collaborative entity. Only one wholesaler believed in an increase in consciousness of the buyers as a result of the Program for Product Quality Analysis. The retailers made special mention of the fear consumers have of buying a product with some kind of irregularity. 3.2.5. Repercussion on the actions of the inspection organs The interviewees, especially the food processors, reported that the food inspection carried out by the appointed government organs was inefficient, and that it had become necessary to transfer this task to another organ, like the INMETRO. The intensity of the repercussion of the Program for Product Quality Analysis on the inspection organs was divided into great, medium and small with the following respective values: 36.4%, 27.2% and 36.4% (Table 1). According to the wholesalers, the Program for Product Quality Analysis has great repercussions on the public food control. On the other hand, the retailers, when questioned about it, registered their indignation about the problem of food inspection in Brazil. In the companiesÕ point of view, government actions should not be conducted by an organ such as
INMETRO, whose obligations do not contemplate the responsibility for food control. 3.2.6. Impact of divulging results on product sales According to the interviewees, the effects of divulging results on the public, only last for a short time. Thus for the majority of the industrial agents, on a medium and long term basis, there is little to worry about on this point. With respect to the impact on sales, the majority of the processors (54.5%) recognize the negative effect (Table 1). This type of information is interesting, since it points to a greater impact on the commerce which resells the products, that is, on the wholesalers and retailers. The effects of divulging the results of the tests on the wholesale market lead to the removal of the products identified as irregular from the shelves. Such a situation persists until new analyses show they are now conforming, as was the case with various brands of rice analyzed by IDEC (2001). This type of cautious measure seems to reveal an immediate effect, at least on a short term scale, of the repercussion of the Program for Product Quality Analysis on the commercial wholesaler. The retailers alleged that the impact on sales of products analyzed by the program is immediate. Consequently the sales of the products fell drastically and this could be noted at the sales outlets. The retailers were unanimous in affirming that immediately after the divulging of irregularities of a determined product, it was removed from the supermarket shelves, these measures being taken by all stores. 3.2.7. Program as a collaborator in the improvement of food product quality In general, more than half of the companies visited alleged that the Program for Product Quality Analysis acts as a collaborator for product improvement (Table 1). However the representatives from the food industries believe that the quality improvement of food products is
550
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
due to the concern of the sector to meet consumer expectation, in addition to the need to pay more attention to quality as a result of programs of this type. The wholesalers believe that the program has made an effective contribution to the quality improvement of products of food origin, and that the companies are concerned to avoid incorporating a negative image into their products, which would certainly be prejudicial to the company. When questioned about the contribution of the program to the improvement of food quality, it was apparent from the responses, that the immediate measure adopted by the retailers was that of not offering the product to the consumer, thus avoiding cases which could affect the image of these agents. With respect to the question of non-conformity detected by the analyses, three of the manufacturers visited presented the following types of irregularity: nomenclature mistake on the label; microbiological contamination and serious microbiological contamination (Table 2). INMETRO had not re-examined the products of any of these companies. As mentioned in Table 2, with respect to the effects of divulging the tests on the companies in whose products the analyses detected irregularities, only one plant, located in the State of Rio Grande do Sul and manufacturing dairy products, removed all their batches of commercialized products from the market after microbiological contamination by Listeria was detected. It must be emphasized that the production of this company was interdicted. Despite the constant criticism during the interviews concerning the methods used to define sampling procedures, when questioned specifically on this point, of all the agents interviewed only one explicit comment was made that the methodology applied was incorrect (Table 2).
4. Discussion and conclusions This evaluation produced important results with respect to the implications of the Program for Product Quality Analysis for Brazilian food manufacturing and commerce. Some of these tendencies could contribute to a better understanding and improvement of programs for product quality analysis developed by consumer organizations in Brazil and other countries. With respect to the repercussions of the Program for Product Quality Analysis, it was shown that in Brazil the food processors were more concerned with the wholesalers and retailers than with the consumers, since these are the intermediaries who deliver the product to the consumer. If these establishments stop acquiring their products, there will certainly be a fall in sales.
The large and medium scale wholesale and retail companies detain a considerable part of the participation on the Brazilian consumer market, and thus the opinion of these sectors with respect to any program of food product quality analyses is critical. This tendency would probably be observed in any country where food commercialization is highly concentrated. Due to the fact that the large wholesale and retail networks have developed their own production, considerable attention has been paid to programs such as the Program for Product Quality Analysis by these businesses. In fact the consumers, after the media divulge some type of product irregularity, tend to substitute that product with another whose quality is not in doubt. This fact was also cited by Liporace (1996) in his survey, carried out in various countries including Brazil, with respect to the action of consumers concerning the quality of goods and services. This author showed that when the name of a company or brand was negatively exposed, the consumers tended to prefer products still considered to be of better quality. However, the companies allege that this impact on product sales of products with some type of non-conformity, is only an immediate reaction, and that as time passes by, the consumers tend to forget about the problem. This tendency can be notably different in other countries, as, for example in the USA, where consumers are more concerned with product quality, and also more organized, with a greater tradition of consumer defense. On the other hand, this result suggests that in countries where consumer concern with quality and its organization are incipient, a program for quality analysis should look for efficient mechanisms of action, especially for divulging the results to the consumer, such that they interfere with consumer behavior on a long term basis, with respect to the buying of food items, also interfering with the quality improvement of the foods (Tabai, 2001). Questions about the mode of action of the program shown to be polemic for the private sector were the form of divulging the results, the sampling process and the responsibility with respect to the quality irregularity detected. The majority of interviewees commented on the sensationalist manner in which the results of the INMETRO analyses are divulged, and on the lack of possibility of a direct response in the media by the companies. The way in which the consumer education proceeded was questioned, since they believe that showing what is incorrect is not the best way to proceed. On this point, one should remember that, according to the Institute, the objective of the Program for Product Quality Analysis was that of divulging irregularities, such that the consumer, being better informed, could make a more conscious choice (INMETRO, 1998a, 1998b). In general, the answers obtained from the managers of the companies which took part in the survey, showed
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
a lack of knowledge with respect to the methodologies adopted by the Program for Product Quality Analysis, for example those of sampling. Thus explanations with respect to methodologies should be divulged by the Institute, to all sectors involved. The question of responsibility in the case of an irregularity was also considered by one company due to the traditional quality of their product, which, after being registered on leaving the company, apparently incorporated some irregularity during the commercialization stages, either as a result of transportation or of inadequate storage. However, the difficulty of proving the exact moment at which the irregularity occurred, resulted in the food manufacturer assuming all the consequences resulting from the adulteration of their products. According to the Consumer Defense Code in Brazil, both the manufacturer and the dealers are considered co-responsible. One perceives that these subjects concern mainly the manufacturers, since when the results of the analyses are divulged by the Program for Product Quality Analysis, there is no mention of where the product was acquired, emphasizing the locality and identifying the manufacturer responsible for that product. It must be pointed out that the presence of molds, moisture and similar irregularities, could easily be due to incorrect storage during commercialization. Thus programs for product quality analysis should also collect information, for instance, within the food distribution system, which could contribute to an understanding of the responsibility for the irregularity in quality. One could even carry out analyses of the same product collected at different points of the distribution system. For the companies, product quality improvement is the result of an ample quality system, the INMETRO program acting merely as a collaborator. However, on the wholesale and retail market, the general opinion was that the program acted as an incentive for an improvement in the products available on the market. It is known that currently the food processors are effectively concerned with the quality of their products. During the Program for Product Quality Analysis activity, various conformity tests were carried out, allowing for the registration of irregularities in the quality of both national and foreign foods (INMETRO, 1998a, 1998b), suggesting that, despite industrial concern with respect to product quality improvement, there is still a need to give priority to quality control processes. It is also important to point out that in the opinion of some of the companies visited, the organizers of the Program for Product Quality Analysis should be the actual government regulator authorities, which, in the case of Brazil, would be the Ministry of Health and the Ministry of Agriculture, Food and Supply. It could be considered that if INMETRO assumed this
551
type of function, which is not really a function of the Institute, the situation probably arose due to the inefficiency of the public inspection services. In fact, this overlap of actions has been one of the characteristics leading to a lack of effect in food control policies in various countries (Salay & Caswell, 1998). Recently, INMETRO started a trial aimed at coordinating the activities of the Ministries of Health and of Agriculture, Food and Supply (Tabai & Salay, 2002).
References Associacß~ao Brasileira das Ind ustrias da Alimentacß~ao (2000). Tecnico–– O que e. Available: http://abia.org.br. Access on: 18 May 2000. Cohen, E., Franco, R. (1988). Evaluacion de projetos sociales. Buenos Aires, Instituto Latinoamericano y del Caribe de Planification Economica y Social (ILPES). Centro Interamericano de Desarollo Social CIDES/OEA. Guilford, C. T. (1993). Involving consumers in food control in the United States. Food Nutrition and Agriculture, 8(9), 32–37. Instituto Brasileiro de Defesa do Consumidor––IDEC (2001). Educacßao do consumidor. Available: http://www.uol.com.br/idec/news. Access on: 12 December 2001. Instituto Nacional de Metrologia, Normalizacß~ao e Qualidade Industrial INMETRO (1998a). Programa de educacß~ao para o consumo. Available: http://www.inmetro.gov.br. Access on: 19 February 1998. Instituto Nacional de Metrologia, Normalizacß~ao e Qualidade Industrial INMETRO (1998b). Programa de analise da qualidade de produtos. Available: http://www.inmetro.gov.br. Access on: 10 June 1998. Instituto Nacional de Metrologia, Normalizacß~ao e Qualidade Industrial INMETRO (1999). Procedimento do programa de analise de produtos. Available: http://www.inmetro.gov.br. Access on: 21 October 1999. Liporace, T.D. (1996). Acß~ao dos consumidores na qualidade de bens e servicßos. Rio de Janeiro, 125p. Master Thesis, Universidade Federal do Rio de Janeiro. Partnership for food safety education (1998). Elevating the importance of safe food handling among consumers. Available: http://fightbac.org/about/elevate. Acess on: 25 June 1998. Salay, E., & Caswell, J. (1998). Developments in Brazilian Food Safety Policy. The International Food and Agribusiness Management Review, Greenwich, 1(2), 167–177. Salay, E., Pereira, J. L., Mercadante, A. M., Netto, F. M., & Cavalli, S. B. (2001). Food safety issues in developing nations: a case study of Brazil. In N. H. Hooker, & E. A. Murano (Eds.), Interdisciplinary food safety research (pp. 87–120). New York: CRC Press. Tabai, K.C. (2001). Avaliacß~ao dos resultados do Programa de Analise da Qualidade de Produtos do Instituto Nacional de Metrologia e Qualidade Industrial INMETRO. Campinas. 139p. PhD Thesis, Faculdade de Engenharia de Alimentos, Universidade Estadual de Campinas. Tabai, K. C., & Salay, E. (2002). O Programa de Analise da Qualidade ~es de o rg~aos de Produtos do INMETRO: Os resultados nas acßo governamentais fiscalizadores de alimentos. Revista Higiene Alimentar, 16(99), 16–28. World Health Organization––WHO (1984). The role of food safety in health and development. Technical Report Series no. 705, Geneva.
Opinion of the food processors, wholesale and retail companies towards the Program for Product Quality Analysis in S~ao Paulo, Brazil K atia Cilene Tabai, Elisabete Salay
*
DEPAN FEA UNICAMP, Caixa Postal 6121, 13083-970 Campinas, S~ ao Paulo, Brazil Received 27 March 2002; received in revised form 14 September 2002; accepted 16 September 2002
Abstract This research seeks to identify the opinion of food manufacturing, wholesale and retail companies towards the Program for Product Quality Analysis in Brazil. Managers from 11 food manufacturing companies and six wholesalers and retailers from the State of S~ao Paulo were interviewed. The results showed that there is a lack of knowledge of the official methodology adopted by the program. The food processors were concerned about the impact the divulging of the results of these analyses would have on the wholesalers and retailers. In addition, they contested the way in which the results were divulged. However the majority of the interviewees believed that the general effect of the program on the society was positive. Ó 2003 Elsevier Ltd. All rights reserved. Keywords: Food safety; Food control; Quality; Brazil
1. Introduction Progress in the food technology area has not impeded the occurrence of food poisoning outbreaks, which affect considerable proportions of populations in various countries. In the USA, one of the largest food producers in the world, it is estimated that each year approximately 9000 deaths and between 6.5 and 33 million cases of disease directly related to food borne pathogens occur. 1; 2 In Brazil there are various cases of microbiological food contamination. However, official data describing the presence of microbiological food poisoning is not systematically divulged (Salay, Pereira, Mercadante, Netto, & Cavalli, 2001). The Ministry of Health and the Ministry of Agriculture, Food and Supply are the organs responsible for food legislation in Brazil. On the other hand, the National Institute of Metrology, Normalization and
*
Corresponding author. Fax: +55-19-3788-4059. E-mail address: [email protected] (E. Salay). 1 Information obtained in a site about food safety (Partnership for food safety education, 1998). 2 Food borne disease is considered as: ‘‘a disease of a normally toxic or infectious nature caused by agents entering the body via food ingestion’’ (WHO, 1984). 0956-7135/$ - see front matter Ó 2003 Elsevier Ltd. All rights reserved. doi:10.1016/S0956-7135(02)00118-4
Industrial Quality––INMETRO, with the collaboration of the State Institute of Weights and Measures––IPEM, analyze the adequacy of the products to the criteria established by the Brazilian legislation with respect to volume, weight and form of packaging. INMETRO also participates in the coordination of the ‘‘Strategic Project for the Consciousness and Education of Consumers and Users’’, one of the projects of the Brazilian Program for Quality and Productivity, developed by the Federal Government. With the objective of better informing the consumer, in 1996 the Institute created the Strategic Project ‘‘Education for Consumption’’, which is composed of two programs: The Program for Product Quality Analysis and the Program for the Education of Consumers. The Program for Product Quality Analysis evaluates quality conformity of diverse products, including those of food origin. It then divulges the results aiming at informing the consumer. Similar programs have been developed in various different countries, such as the United States of America, France, Germany, Spain and Holland (Guilford, 1993; Liporace, 1996). However, evaluations of the results of these actions are scarce. The present survey aims at analyzing the opinion of the private sector on the effects of the Program for Product Quality Analysis developed by INMETRO in food
546
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
industries and commercial establishments based in the State of S~ ao Paulo, Brazil.
2. Methods This survey used a program evaluation approach to identify and analyze the effects of the Program for Product Quality Analysis on the food companies. According to Cohen and Franco (1988), the type of program evaluation depends on the specific nature and objectives of each study. In this way the authors observed that it is by way of an evaluation of programs that one manages to obtain information on the impact of policies, allowing for the reorganization of the actions in order to attain the proposed goals and objectives. The Program for Product Quality Analysis carries out the analyses of product conformity with the norms or technical regulations. For this it adopts a series of procedures described in INMETRO (1999). Prominent amongst these procedures is the fact that the Institute uses market research to select the products to be analyzed. The tests are carried out by certified laboratories or those recognized by the Government Inspection Network. Buying of the samples is carried out emphasizing questions related to the integrity of the packages, the observation of shelf life deadlines and the conditions of preservation, handling, storage and transport. The results are first divulged to the manufacturer of the products analyzed, establishing a period of five working days for their manifestation. Documents registering results which could compromise public health are subsequently sent to the organs responsible for regulation and inspection and also to those entities representing the manufacturers, without identification of the brands and their respective manufacturers. Finally the results are divulged to the press and other interested organs. 2.1. Survey design The period studied in this survey was that between the implantation of the Program for Product Quality Analysis (1996) until 1999. It was considered that a period of four years would be representative for the analysis of the results of the program as applied to food companies. In fact, by way of the Program for Product Quality Analysis, 59 products of food origin, involving 567 manufacturers and 638 brands, were evaluated during these four years. Of the companies involved, about 100 had their administrative headquarters in the State of S~ ao Paulo and had their products analyzed between 1996 and 1999. Contact was made with all these companies (N ¼ 100), but only 11 designated technicians for interviews. After carrying out these interviews, the need to also check the opinion of wholesalers and retailers about the Program
for Product Quality Analysis became apparent. All the available commercial outlets in the City of Campinas, State of S~ao Paulo, approximately 30 establishments, whose units were represented by a volume of sales in other parts of the country considered large, were contacted. It was possible to interview two commercial wholesalers and four commercial retailers. Considering that these establishments commercialized an important volume of food in the country, it was accepted that they could offer significant data on the opinion of the companies with respect to the effects of the program. The food industries and commercial wholesalers and retailers visited were catalogued and numbered based on the industrialized products analyzed in the case of the industries, and the respective categories in the case of the commercial establishments. Thus for companies nos. 1 and 2, hearts of palm in conserve were analyzed; for company no. 3, refined salt was analyzed; for company no. 4, three products were analyzed––milk, crackers and spaghetti; for company no. 5, coffee was the object of study; for no. 6 only milk quality was examined; whereas company no. 7, in addition to milk, fresh Minas type cheese was examined; for company no. 8, tea was the object of analysis; for industry no. 9 vinegar and hearts of palm in conserve were analyzed; and for company no. 10, the qualities of margarine, tomato extract and olive oil were examined; for no. 11, ‘‘prato’’ and fresh type cheeses were examined and also powdered, UHT and flavored milks; and companies nos. 12 and 13 were the commercial wholesalers visited and nos. 14–17 the commercial retailers visited, all in the Campinas area. 3 From January to July 2000, interviews were carried out with the firm managers and with the technician responsible for the Program for Product Quality Analysis subject in the Brazilian Association of Food Processors ABIA, 4 using structured and semi-structured questions. The data obtained by way of interviews was systematized and the analyses presented are descriptive. 2.2. Indicators Considering the objectives of the evaluation proposed, that is, to identify the results of the Program for Product Quality Analysis in the companies, some indi3 Numbers were used for the above mentioned companies instead of their names, which were not cited to preserve the sources of information considered in this survey. 4 ABIA represents the Brazilian food processors in the institutional forums, defending their interests. The Association acts together with its approximately 2000 associates, which are the food industries and connected companies (such as, for example, the food packaging companies), Federal, State and Municipal authorities, international organs, universities, research institutes and professional individuals in the food area (ABIA, 2000).
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
cators were defined for this analysis. Taking into consideration the unprecedented character of the current survey, it was decided to use qualitative data to represent the opinion of the business sector with respect to the program. In addition, the individuals expressed their opinion using a dual (yes and no) or a three point scale (for example: great effect, medium effect or small effect) for some indicators. The indicators used are related below. 2.3. ABIA 1. Opinion of ABIA with respect to Program for Product Quality Analysis; 2. Actions of ABIA with respect to Program for Product Quality Analysis. 2.4. Food processors, wholesalers and retailers 1. Knowledge of the companies about the Program for Product Quality Analysis of INMETRO and the methodology adopted in the Program for Product Quality Analysis; 2. View of the companies with respect to the divulging of results by the televised press; 3. General effect of the analyses on the companies; 4. Effect on the consciousness of the consumers/buyers; 5. Repercussion to the actions of the inspection organs; 6. Impact of the divulging of the results on product sales; 7. Program as collaborator for the improvement of food product quality; 8. Irregularities identified in the analysis of food products; 9. Consequences of the divulging of the results of the tests for the food industries on the consumer market; 10. Procedures adopted by the food industries as a result of the divulging of the Program for Product Quality Analysis results; 11. Criticism of the methodologies adopted in the Program for Product Quality Analysis and divulged in the press.
3. Results 3.1. View of the ABIA In the opinion of ABIA, the Program for Product Quality Analysis affects the whole food sector, and not just the food manufacturers. According to the association, the Brazilian consumers are now more aware of their rights, and INMETRO has contributed to this by way of the Program for Product Quality Analysis. ABIA considers this program to be important, since they be-
547
lieve that in many cases, inspection by the competent organs is precarious in Brazil. The association considers the effects of the Program for Product Quality Analysis to be positive for the companies, so long as the irregularities shown by the analyses are real and correct. In the view of the Association, divulging by the televised press is important, but not in the case of small irregularities, which do not reflect in risks to the consumer. ABIA questions some of the methods used for product quality analysis by the laboratories and is in favor of changing the sampling criteria, believing that the choice of products for these analyses should be more representative. With respect to the Program for Product Quality Analysis, ABIA acts for both INMETRO and the companies, being consulted by INMETRO about technologies, laboratories and updating of the legislation, amongst other items. With respect to the companies, the Association gives technical and legal support as necessary, for example, when the result of the quality analysis of a product presents a product composition different to that stated on the label. The food processors have a given period to reply after receiving the results of the analyses, and, depending on these, the company can take legal action, and INMETRO accept the action.
3.2. Effects of program for product quality analysis on food processors, wholesalers and retailers 3.2.1. Knowledge by the companies about the program for product quality analysis Table 1 shows that all the manufacturers visited acknowledged knowing about the Program for Product Quality Analysis, since their products had been analyzed. On the other hand, they affirmed they did not officially know which methodology had been adopted by the institute. For the representatives of the wholesale companies interviewed, their knowledge of the Program for Product Quality Analysis was limited to what was transmitted by the press. With respect to the representatives of the retailers interviewed, they were divided between those with limited knowledge and those who only knew what was transmitted by the press, plus the fact of having no knowledge of the methodology used. The food manufacturers emphasized that the people have a right to access this type of information. Based on the group of industries visited, it can be seen that 65% of those interviewed considered the procedure established by INMETRO with respect to the divulging by the press, as a positive aspect (Table 1). However the individuals observed that the way in which the press had done this divulging could be improved. The company recognizes the importance of the Program for Product Quality Analysis, although one can also observe the
548
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
Table 1 The program for product quality analysis for products of food origin of the National Institute of Metrology and Industrial Quality––INMETRO: description of the effects on the food processors and commerce of the State of S~ao Paulo, 2000 Effects of the Program for Product Quality Analysis of INMETRO
Processors
Wholesalers %
N
%
Knowledge of the company about the Program for Product Quality Analysis Yes 11 100.0 No 0 0.0
2 0
100.0 0.0
4 0
100.0 0.0
Knowledge of the methodology of Program for Product Quality Analysis Yes 0 0.0 No (except that transmitted by the media) 11 100.0
0 2
0.0 100.0
2 2
50.0 50.0
View of the divulging by the press Positive Negative No opinion
7 2 2
63.6 18.2 18.2
2 0 0
100.0 0.0 0.0
2 1 1
50.0 25.0 25.0
General effect of the analyses on the companies Positive Negative No effect
8 2 1
72.7 18.2 9.1
1 1 0
50.0 50.0 0.0
3 1 0
75.0 25.0 0.0
Consciousness of consumers/buyers Greater Lesser No effect
6 3 2
54.5 27.3 18.2
1 1 0
50.0 50.0 0.0
4 0 0
100.0 0.0 0.0
Repercussion in the Inspection organs Great Medium Small
4 3 4
36.4 27.2 36.4
2 0 0
100.0 0.0 0.0
0 0 4
0.0 0.0 100.0
Impact on product sales Positive Negative No effect
2 6 3
18.2 54.5 27.3
2 0 0
100.0 0.0 0.0
3 0 1
75.0 0.0 25.0
63.6 36.4
2 0
100.0 0.0
3 1
75.0 25.0
Program for Product Quality Analysis collaborator of food quality Yes 7 No 4
indignation of some interviewees with respect to the sensationalism of the divulging by the media. Despite the constant criticism during the interviews concerning the methods used to define sampling procedures, when questioned specifically on this point, of all the agents interviewed only one explicit comment was made that the methodology applied was incorrect (Table 2). 3.2.2. View and procedures of the companies with respect to divulging by the televised press Divulging of the analyses by the press is recognized as a positive action by the wholesalers. On the other hand, the retailers were divided on the subject of divulging the results of the analyses by the press, emphasizing that this represents a kind of ‘‘consumer alert’’, but that it is not always done as they believe it should be done, since the press apparently prefers to emphasize the mistakes and not the correct actions. The fear of criticism and slander appear to stimulate reactions of aversion in these professionals.
%
Retailers
N
N
The majority of the food processors alleged having no pre-established position as a response to the consumers after the media divulged their problems. Only two industries admitted concern about this type of action, since they had already organized a Customer Service (Table 2). 3.2.3. General effect of the analyses on the society The majority of the food processors interviewed, about 70%, alleged a general positive effect of the Program for Product Quality Analysis (Table 1). The effects of the Program for Product Quality Analysis analyses tend to show negative repercussions only for those companies in whose products irregularities were detected and divulged, reaching a large contingent of the population. Opinion on the effects of the program for the wholesale network was divided: half of them think it is positive and half think it is negative. The majority (75%) of the retailers interviewed believed that the Program for Product Quality Analysis exerts a generally positive
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
549
Table 2 The Program for Product Quality Analysis for food products, of the National Institute of Metrology and Industrial Quality––INMETRO and the food processors in S~ ao Paulo, Brazil, 2000 Effects of the Program for Product Quality Analysis of INMETRO
Processors N
Irregularities shown by the analyses Yes 3 No 8 Effects of the irregularities detected by the analyses Removed the batchesa 1 None 10 Procedures adopted in virtue of divulging the results Customer Service 2 None 9 Criticism of the Program for Product Quality Analysis methodology divulged by the media Yes 1 No 10 a
% 27.3 72.7 9.1 90.9 18.2 81.8 9.1 90.9
The plant that removed all their batches of commercialized products from the market was located in the State of Rio Grande do Sul.
effect, since the consumers, after being warned by the television program, substitute irregular products with those that conform to quality standards (Table 1). 3.2.4. Consumer/buyer consciousness More than half of the food processors considered that, in general, the consumers show a greater level of consciousness. However they believe that this situation is conditioned by the action of other consumer defense organs and by the whole movement generated by the Brazilian Consumer Defense Code, which came into effect in 1991. The companies recognize that other organizations are acting in favor of the consumer and that INMETRO is just one more collaborative entity. Only one wholesaler believed in an increase in consciousness of the buyers as a result of the Program for Product Quality Analysis. The retailers made special mention of the fear consumers have of buying a product with some kind of irregularity. 3.2.5. Repercussion on the actions of the inspection organs The interviewees, especially the food processors, reported that the food inspection carried out by the appointed government organs was inefficient, and that it had become necessary to transfer this task to another organ, like the INMETRO. The intensity of the repercussion of the Program for Product Quality Analysis on the inspection organs was divided into great, medium and small with the following respective values: 36.4%, 27.2% and 36.4% (Table 1). According to the wholesalers, the Program for Product Quality Analysis has great repercussions on the public food control. On the other hand, the retailers, when questioned about it, registered their indignation about the problem of food inspection in Brazil. In the companiesÕ point of view, government actions should not be conducted by an organ such as
INMETRO, whose obligations do not contemplate the responsibility for food control. 3.2.6. Impact of divulging results on product sales According to the interviewees, the effects of divulging results on the public, only last for a short time. Thus for the majority of the industrial agents, on a medium and long term basis, there is little to worry about on this point. With respect to the impact on sales, the majority of the processors (54.5%) recognize the negative effect (Table 1). This type of information is interesting, since it points to a greater impact on the commerce which resells the products, that is, on the wholesalers and retailers. The effects of divulging the results of the tests on the wholesale market lead to the removal of the products identified as irregular from the shelves. Such a situation persists until new analyses show they are now conforming, as was the case with various brands of rice analyzed by IDEC (2001). This type of cautious measure seems to reveal an immediate effect, at least on a short term scale, of the repercussion of the Program for Product Quality Analysis on the commercial wholesaler. The retailers alleged that the impact on sales of products analyzed by the program is immediate. Consequently the sales of the products fell drastically and this could be noted at the sales outlets. The retailers were unanimous in affirming that immediately after the divulging of irregularities of a determined product, it was removed from the supermarket shelves, these measures being taken by all stores. 3.2.7. Program as a collaborator in the improvement of food product quality In general, more than half of the companies visited alleged that the Program for Product Quality Analysis acts as a collaborator for product improvement (Table 1). However the representatives from the food industries believe that the quality improvement of food products is
550
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
due to the concern of the sector to meet consumer expectation, in addition to the need to pay more attention to quality as a result of programs of this type. The wholesalers believe that the program has made an effective contribution to the quality improvement of products of food origin, and that the companies are concerned to avoid incorporating a negative image into their products, which would certainly be prejudicial to the company. When questioned about the contribution of the program to the improvement of food quality, it was apparent from the responses, that the immediate measure adopted by the retailers was that of not offering the product to the consumer, thus avoiding cases which could affect the image of these agents. With respect to the question of non-conformity detected by the analyses, three of the manufacturers visited presented the following types of irregularity: nomenclature mistake on the label; microbiological contamination and serious microbiological contamination (Table 2). INMETRO had not re-examined the products of any of these companies. As mentioned in Table 2, with respect to the effects of divulging the tests on the companies in whose products the analyses detected irregularities, only one plant, located in the State of Rio Grande do Sul and manufacturing dairy products, removed all their batches of commercialized products from the market after microbiological contamination by Listeria was detected. It must be emphasized that the production of this company was interdicted. Despite the constant criticism during the interviews concerning the methods used to define sampling procedures, when questioned specifically on this point, of all the agents interviewed only one explicit comment was made that the methodology applied was incorrect (Table 2).
4. Discussion and conclusions This evaluation produced important results with respect to the implications of the Program for Product Quality Analysis for Brazilian food manufacturing and commerce. Some of these tendencies could contribute to a better understanding and improvement of programs for product quality analysis developed by consumer organizations in Brazil and other countries. With respect to the repercussions of the Program for Product Quality Analysis, it was shown that in Brazil the food processors were more concerned with the wholesalers and retailers than with the consumers, since these are the intermediaries who deliver the product to the consumer. If these establishments stop acquiring their products, there will certainly be a fall in sales.
The large and medium scale wholesale and retail companies detain a considerable part of the participation on the Brazilian consumer market, and thus the opinion of these sectors with respect to any program of food product quality analyses is critical. This tendency would probably be observed in any country where food commercialization is highly concentrated. Due to the fact that the large wholesale and retail networks have developed their own production, considerable attention has been paid to programs such as the Program for Product Quality Analysis by these businesses. In fact the consumers, after the media divulge some type of product irregularity, tend to substitute that product with another whose quality is not in doubt. This fact was also cited by Liporace (1996) in his survey, carried out in various countries including Brazil, with respect to the action of consumers concerning the quality of goods and services. This author showed that when the name of a company or brand was negatively exposed, the consumers tended to prefer products still considered to be of better quality. However, the companies allege that this impact on product sales of products with some type of non-conformity, is only an immediate reaction, and that as time passes by, the consumers tend to forget about the problem. This tendency can be notably different in other countries, as, for example in the USA, where consumers are more concerned with product quality, and also more organized, with a greater tradition of consumer defense. On the other hand, this result suggests that in countries where consumer concern with quality and its organization are incipient, a program for quality analysis should look for efficient mechanisms of action, especially for divulging the results to the consumer, such that they interfere with consumer behavior on a long term basis, with respect to the buying of food items, also interfering with the quality improvement of the foods (Tabai, 2001). Questions about the mode of action of the program shown to be polemic for the private sector were the form of divulging the results, the sampling process and the responsibility with respect to the quality irregularity detected. The majority of interviewees commented on the sensationalist manner in which the results of the INMETRO analyses are divulged, and on the lack of possibility of a direct response in the media by the companies. The way in which the consumer education proceeded was questioned, since they believe that showing what is incorrect is not the best way to proceed. On this point, one should remember that, according to the Institute, the objective of the Program for Product Quality Analysis was that of divulging irregularities, such that the consumer, being better informed, could make a more conscious choice (INMETRO, 1998a, 1998b). In general, the answers obtained from the managers of the companies which took part in the survey, showed
K.C. Tabai, E. Salay / Food Control 14 (2003) 545–551
a lack of knowledge with respect to the methodologies adopted by the Program for Product Quality Analysis, for example those of sampling. Thus explanations with respect to methodologies should be divulged by the Institute, to all sectors involved. The question of responsibility in the case of an irregularity was also considered by one company due to the traditional quality of their product, which, after being registered on leaving the company, apparently incorporated some irregularity during the commercialization stages, either as a result of transportation or of inadequate storage. However, the difficulty of proving the exact moment at which the irregularity occurred, resulted in the food manufacturer assuming all the consequences resulting from the adulteration of their products. According to the Consumer Defense Code in Brazil, both the manufacturer and the dealers are considered co-responsible. One perceives that these subjects concern mainly the manufacturers, since when the results of the analyses are divulged by the Program for Product Quality Analysis, there is no mention of where the product was acquired, emphasizing the locality and identifying the manufacturer responsible for that product. It must be pointed out that the presence of molds, moisture and similar irregularities, could easily be due to incorrect storage during commercialization. Thus programs for product quality analysis should also collect information, for instance, within the food distribution system, which could contribute to an understanding of the responsibility for the irregularity in quality. One could even carry out analyses of the same product collected at different points of the distribution system. For the companies, product quality improvement is the result of an ample quality system, the INMETRO program acting merely as a collaborator. However, on the wholesale and retail market, the general opinion was that the program acted as an incentive for an improvement in the products available on the market. It is known that currently the food processors are effectively concerned with the quality of their products. During the Program for Product Quality Analysis activity, various conformity tests were carried out, allowing for the registration of irregularities in the quality of both national and foreign foods (INMETRO, 1998a, 1998b), suggesting that, despite industrial concern with respect to product quality improvement, there is still a need to give priority to quality control processes. It is also important to point out that in the opinion of some of the companies visited, the organizers of the Program for Product Quality Analysis should be the actual government regulator authorities, which, in the case of Brazil, would be the Ministry of Health and the Ministry of Agriculture, Food and Supply. It could be considered that if INMETRO assumed this
551
type of function, which is not really a function of the Institute, the situation probably arose due to the inefficiency of the public inspection services. In fact, this overlap of actions has been one of the characteristics leading to a lack of effect in food control policies in various countries (Salay & Caswell, 1998). Recently, INMETRO started a trial aimed at coordinating the activities of the Ministries of Health and of Agriculture, Food and Supply (Tabai & Salay, 2002).
References Associacß~ao Brasileira das Ind ustrias da Alimentacß~ao (2000). Tecnico–– O que e. Available: http://abia.org.br. Access on: 18 May 2000. Cohen, E., Franco, R. (1988). Evaluacion de projetos sociales. Buenos Aires, Instituto Latinoamericano y del Caribe de Planification Economica y Social (ILPES). Centro Interamericano de Desarollo Social CIDES/OEA. Guilford, C. T. (1993). Involving consumers in food control in the United States. Food Nutrition and Agriculture, 8(9), 32–37. Instituto Brasileiro de Defesa do Consumidor––IDEC (2001). Educacßao do consumidor. Available: http://www.uol.com.br/idec/news. Access on: 12 December 2001. Instituto Nacional de Metrologia, Normalizacß~ao e Qualidade Industrial INMETRO (1998a). Programa de educacß~ao para o consumo. Available: http://www.inmetro.gov.br. Access on: 19 February 1998. Instituto Nacional de Metrologia, Normalizacß~ao e Qualidade Industrial INMETRO (1998b). Programa de analise da qualidade de produtos. Available: http://www.inmetro.gov.br. Access on: 10 June 1998. Instituto Nacional de Metrologia, Normalizacß~ao e Qualidade Industrial INMETRO (1999). Procedimento do programa de analise de produtos. Available: http://www.inmetro.gov.br. Access on: 21 October 1999. Liporace, T.D. (1996). Acß~ao dos consumidores na qualidade de bens e servicßos. Rio de Janeiro, 125p. Master Thesis, Universidade Federal do Rio de Janeiro. Partnership for food safety education (1998). Elevating the importance of safe food handling among consumers. Available: http://fightbac.org/about/elevate. Acess on: 25 June 1998. Salay, E., & Caswell, J. (1998). Developments in Brazilian Food Safety Policy. The International Food and Agribusiness Management Review, Greenwich, 1(2), 167–177. Salay, E., Pereira, J. L., Mercadante, A. M., Netto, F. M., & Cavalli, S. B. (2001). Food safety issues in developing nations: a case study of Brazil. In N. H. Hooker, & E. A. Murano (Eds.), Interdisciplinary food safety research (pp. 87–120). New York: CRC Press. Tabai, K.C. (2001). Avaliacß~ao dos resultados do Programa de Analise da Qualidade de Produtos do Instituto Nacional de Metrologia e Qualidade Industrial INMETRO. Campinas. 139p. PhD Thesis, Faculdade de Engenharia de Alimentos, Universidade Estadual de Campinas. Tabai, K. C., & Salay, E. (2002). O Programa de Analise da Qualidade ~es de o rg~aos de Produtos do INMETRO: Os resultados nas acßo governamentais fiscalizadores de alimentos. Revista Higiene Alimentar, 16(99), 16–28. World Health Organization––WHO (1984). The role of food safety in health and development. Technical Report Series no. 705, Geneva.