The PACTE group uses empirical-experimental research methods to investigate translation competence and how it is acquired. This article presents the design of our Translation Competence research project and the first results of a pilot test carried out to evaluate our research design and the instruments that will be used in the experiment. The first results of the pilot test are related to decision-taking in the translation process and the interrelation between the use of internal and external support. The results point to differences in the processes followed by professional translators and other language professionals. Furthermore, the pilot test has proved the reliability of our instruments.
- empirical-experimental research,
- translation competence,
- internal support,
- external support
Le groupe PACTE conduit une recherche empirique-expérimentale sur la compétence de traduction et son processus d’acquisition en traduction écrite. Cet article explique comment est conçue la recherche sur la compétence de traduction et rend compte des résultats d’une épreuve pilote dont l’objectif était d’évaluer les modalités de la recherche et l’efficacité des instruments qui seraient utilisés pour l’expérimentation définitive. Ces premiers résultats concernant le mode de fonctionnement de la prise de décisions au cours du processus de traduction ainsi que l’interrelation entre l’utilisation de l’aide interne et de l’aide externe montrent, d’une part, que ce fonctionnement est différent entre traducteurs professionnels et autres professionnels enseignant des langues, et, d’autre part, que les instruments à disposition sont efficaces.
Introduction: the PACTE Group Research project
Our research aims at a better understanding about how translation competence is acquired. The project has two main stages: (1) a study of translation competence (TC) (2) a study of the acquisition of translation competence. This first stage, in which we are currently working, is essential, given the lack of empirical studies on how TC functions. We work with 6 language combinations: German, French and English (as B languages) – Spanish and Catalan (as A languages). 
This is an empirical-experimental research project that studies both the translation process and the translation product. Thus, different methods are used to collect data about the process (experimental studies) and the product (corpus methodology) and the results are triangulated. However, given the lack of empirically tested translation competence models and validated data collecting instruments, we had to begin with exploratory and pilot tests before embarking on the final experiment. In 2000 an observational exploratory test was carried out with 5 professional translators (PACTE, 2002); in 2004 a pilot test was carried out with 3 professional translators and 3 foreign-language teachers, the results of which are now being analysed.
1. Translation Competence
The main aim of this first stage of our research is to identify the distinguishing features of translation competence. However, there are two collateral objectives: (1) to validate our holistic TC model; (2) to validate the TC measuring instruments.
Our TC model was first presented in 1998 and later on (PACTE 1998a, 1998b, 2000, 2001), and it was recently remodelled in the light of the results of the 2000 exploratory test (PACTE 2003). In this model, TC is considered to be the underlying knowledge system needed to translate and has four distinctive characteristics: (1) it is expert knowledge and not possessed by all bilinguals; (2) it is basically procedural knowledge (and not declarative); (3) it is made up of various interrelated sub-competencies; (4) the strategic component is very important, as it is in all procedural knowledge. The TC model proposed is made up of 5 sub-competencies and psycho-physiological components (PACTE 2003).
The bilingual sub-competence is made up of pragmatic, socio-linguistic, textual and lexical-grammatical knowledge in each language. The extra-linguistic sub-competence is made up of encyclopaedic, thematic and bicultural knowledge. The translation knowledge sub-competence is knowledge of the principles that guide translation (processes, methods and procedures, etc.) and the profession (types of translation briefs, users, etc.). The instrumental sub-competence is made up of knowledge related to the use of documentation sources and information technologies applied to translation. The strategic sub-competence is the most important, as it is responsible for solving problems and the efficiency of the process. It intervenes by planning the process in relation to the translation project, evaluating the process and partial results obtained, activating the different sub-competencies and compensating for deficiencies, identifying translation problems and applying procedures to solve them. The psycho-physiological components are cognitive and behavioural (memory, attention span, perseverance, critical mind, etc.) and psychomotor mechanisms.
Given that any bilingual has knowledge of two languages and may have extra-linguistic knowledge, we consider that the sub-competencies specific to TC are the strategic, the instrumental and knowledge about translation. Therefore, our research is focused on these three sub-competencies. Empirical and operative hypotheses have been formulated using this model, beginning with the basic hypothesis that the translator’s degree of expertise influences the translation process and product.
2. Research design
2.1. Universe and sample
The universe from which our sample taken: is professionals working with foreign languages and two groups of subjects have been selected: expert translators and teachers of foreign languages. Teachers of foreign languages with at least six years of experience were chosen because they share some of the characteristics of expert translators; according to our model, they possess the bilingual and extra-linguistic sub-competences but not the other three. We define expert translators as translators with at least 6 years of experience in a variety of fields for whom translation is their main professional activity and provides at least 70% of their income.
2.2. Data collecting materials
Different types of materials have been used to collect data about the translation process and product so that the results can be triangulated.
Texts and translations. Electronic corpus of source texts (for direct and inverse translation) and translations carried out in the experiment. The source texts have been selected using the following criteria: (1) texts of the same genre in the same field for all the languages studied; (2) texts with a rich variety of problems; (3) short texts (175 to 300 words); (4) text genres translated by professional translators in Spain.
Translation protocols (Neunzig 2000): PROXY recordings. PROXY is a programme (compatible with Windows) designed for the remote control of computers and users connected to a network. By using PROXY it is possible to view and record the subjects’ actions on the computer in real time and store these recordings for later study and data collection.
Direct observation. Direct observation is also used to collect data about the translators’ behaviour that cannot be recorded by PROXY.
Questionnaires. Different types of questionnaires are used: (1) an initial questionnaire to select subjects, (2) a questionnaire for subjects to identify the problems encountered in the translation process, (3) a questionnaire to measure the subjects’ knowledge about translation
Retrospective interviews. Data are also collected in retrospective interviews with the subjects while viewing the PROXY recording.
2.3. Experimental tasks
The tasks carried out by the subjects are: (1) Translation into their A language (direct translation); (2) Filling in a questionnaire about the problems encountered in the translation; (3) Translation into their B language (inverse translation); (4) Filling in a questionnaire about the problems encountered in the translation; (5) Filling in a questionnaire about translation knowledge; (6) Participating in a retrospective interview while viewing their PROXY recording. The translation process is recorded through PROXY and direct observation.
2.4. Research variables
In this study there is one independent variable and five dependent variables. The independent variable is translation expertise defined as years working as a translator when this is the main professional activity. The two experimental groups are constituted following this definition: Group 1: expert translators (more than 6 years of experience); Group 2: language teachers (zero years of translation experience). The dependent variables are: the translation project, the identification of translation problems, decision taking, translation knowledge and efficiency of the process. The following aspects have been defined for each variable: objective, conceptual definition, operative definition, operative hypotheses, indicators, materials and instruments. For reasons of space, in the following table we will only present the conceptual definition, indicators, materials and instruments.
The main instruments designed to collect data are described briefly here and some are illustrated in the Appendix.
Initial questionnaire. Two questionnaires are used, one for each group of subjects, to select those who fulfil the established requirements. They collect data about age, A and B languages, academic training, translation experience, etc.
Categories of actions. In order to follow the decision-taking process adopted by the subjects to solve translation problems, we needed to label the “actions” carried out while they were translating. These actions reflect decisions taken by the subjects and are observable (although they may be the result of other procedures that cannot be observed). Sixteen categories of actions have been identified from the results of the 2000 exploratory test (PACTE 2002): First reading of the ST, Underlining, Provisional solution, Revision, etc. A selection was made of the five categories that were considered to be most relevant to TC:Reading the source text Pause (+ than 5 seconds) Provisional SolutionDefinitive Solution Consultation
Direct observation chart. This chart is used to collect data on the “external” behaviour of the subjects in each stage of the process (orientation, development and revision) that cannot be recorded by PROXY (See Appendix 1).
Problems questionnaire. The subjects fill in this questionnaire after translating each text. They are asked to select 5 elements in the text that are problems for them and indicate the degree of difficulty of the text (See Appendix 2).
Translation knowledge questionnaire. This questionnaire of 36 questions has been designed around the 7 indicators of the translation knowledge variable (translation and translation competence, translation units, etc.). For each indicator, 4 or 5 questions have been formulated based on two paradigms of ways of thinking about translation: one is labelled “dynamic” (textual, communicative, functionalist concepts) and the other “static” (linguistic and literal concepts). Thus, for example, the questions related to the “translation unit” are:
(D) The whole text has to be taken into account in order to translate.
(D) The ST segment that is translated has no specific length (word, phrase, paragraph). It varies in each case.
(S) The best way to translate a text is phrase by phrase.
(S) The best way to translate is word for word, unless there are set expressions or metaphors.
(See Appendix 3)
Selection and characterization of “rich points” in the source text. In order to collect data on the decision-taking variable, we decided to concentrate on a few selected elements in the source text. The three essential characteristics of these elements, that we have denominated as “rich points,” are: (1) that they should provide variety in the types of translation problems studied, (2) that they do not lead to immediate and acceptable solutions and (3) that they should be homogeneous in all the languages (so comparisons can be made). The inverse translation source text is included in Section 3.2. with the selected elements marked in bold. Each element selected is analysed in terms of the type of problem, its relevant characteristics and the acceptable and partially acceptable characteristics.
Criteria used to evaluate the acceptability of results. Criteria of acceptability are needed to study those variables related to the results obtained by the subjects, i.e., decision-taking and efficiency of the process. Criteria have been designed to distinguish between acceptable, partially acceptable and unacceptable solutions:
ACCEPTABLE SOLUTION: Congruence between the ST and the TT. The solution activates all the relevant connotations of the ST in the translation context.
PARTIALLY ACCEPTABLE SOLUTION: Some congruence between the ST and the TT and total congruence within the TT. The solution activates some of the relevant connotations of the ST in the translation context and the TT is congruent in the translation context.
UNACCEPTABLE SOLUTION: No congruence between the ST and the TT or within the TT. Either, the solution does not activate any of the relevant connotations of the ST, or, it activates connotations that are incongruent in the translation context.
Chart of consultation categories. In order to describe the subjects’ actions, documentation consultations have been classified according to three categories: the type of search carried out, the medium of the information source and the languages used (See Appendix 4).
3. First results of the pilot test: use of internal and external support in talking decisions
We are now analysing the data from the pilot test with 3 expert translators and 3 language teachers. From all the data obtained to date, the information related to the “decision-taking” variable seems to be particularly interesting.
3.1. Identification of sequences of actions
The analysis of the subjects’ action during the translation process has revealed the existence of a variety of different sequences of actions. These have been classified into five categories according to the degree of cognitive implication required, i.e., in the use of internal and external support. The two extremes are: the use of simple internal support, when a Definitive Solution is reached without any consultation, and the use of simple external support, when the support used to reach a Definitive Solution is a bilingual dictionary. “Complex consultations” have been identified: when there is a chain of consultations or a complex search (for example using an Internet searcher in a contextualized way). The five categories are:
Simple internal support (IS). The definitive solution is reached by using internal support alone, without external consultation. Two typical sequences are: (a) Definitive Solution; (b) Pause – Definitive Solution
Internal support dominant combined with external support (ISD). Complex documentation searches are made but they do not lead to a definitive solution. The Definitive Solution is the result of internal support. For example: Complex Consultation – Provisional Solution – Pause – Definitive Solution
Balanced interaction between internal and external support (IS-ES). Both internal and external support is used and the definitive solution is the result of interaction between the two. Three subcategories have been identified:
Consultation (of any kind) is used to confirm a decision. For example: Pause – Definitive Solution – Consultation
Consultation (bilingual or monolingual dictionary) is used but the dictionary solution is not accepted. For example: BL/ML Consultation – Pause – Provisional Solution – Definitive Solution
Internal support is combined with consultation (bilingual or monolingual dictionary) and the solution is accepted. For example: Pause – BL/ML Consultation – Definitive Solution
External support dominant combined with internal support (ESD). Complex consultations are the basis for a definitive solution. The Definitive Solution is the result of external support. Two examples: (a) Provisional Solution – Pause – BL Consultation – ML Consultation – Definitive Solution; (b) Contextualized Internet searcher – Definitive Solution
Simple External Support (ES). A bilingual dictionary is consulted and the solution is accepted. Therefore, the definitive solution is the result of external support. A typical sequence is: BL Consultation – Definitive Solution
The following graph shows the degree of cognitive implication required for the five categories of sequences:
3.2. Process and product data from the inverse translation task
By using the above categories, we have been able to triangulate process and product data from the inverse translations of the following text. (The “rich points” selected have been marked in bold).
The sequences of actions used by the subjects to translate the “rich points” have been identified and related to the acceptability/partial acceptability or unacceptability of the results. The acceptability of the results has been determined in relation to the relevant characteristics of each “rich point.” For example, “indiano”:
a Spanish emigrant returning with a fortune from Latin America
cohesive relation with “fortuna del americano”
Acceptable solutions: brief explanation; omission, etc. Partially acceptable solutions: long explanation
The following tables show the data for the inverse translation distributed according to the three categories: acceptability/partial acceptability or unacceptability of the results. 
The following tendencies have been observed:
Simple external support (ES) is used more by the language teachers than the translators. Furthermore, they are also more likely to use simple external support after internal support (IS-ES c).
Simple internal support (IS): (a) is used more by the language teachers to reach unacceptable solutions; (b) is used more by the translators to reach acceptable solutions. Furthermore, the translators are more likely to use predominantly internal support (ISD) and external support to confirm decisions (IS-ES a).
External support dominant (ESD): (a) this sequence is used more by the translators than language teachers; (b) it is the type of external support most used by the translators; (c) this sequence leads to more acceptable results (for both translators and language teachers)
The majority of the unacceptable solutions are provided by the language teachers and the most common sequences used to reach these unacceptable solutions are: simple internal support (IS) and simple external support (ES).
The majority of the acceptable solutions (for both translators and language teachers) are reached by the use of external and internal support (ISD, IS-ES, ESD).
These first results from the pilot test seem to confirm our general hypothesis that the degree of expertise influences the translation process and product. By tracking sequences of actions we can learn more about how decision-taking functions in the translation process and the interaction between internal and external support. Furthermore, the results point to differences in the processes followed by language teachers and translators. On the other hand, the pilot test has proved the reliability of our instruments because they have allowed us to measure what we wanted to measure: the decision-taking processes followed by our two experimental groups. Hopefully, we shall soon be able to present further results.
Direct Observation Chart
STAGE: Orientation/Development/Revison STRATING TIME: . . .Time Action Text segment Commentaries andconsultation detailsReading ConsultationPause OtherReading ConsultationPause Other
The five most problematic elements to translateProblem 1: Why do you consider this to be an important problem?Are you satisfied with your solution? Yes No Why?
Indicate the degree of difficulty of this translation1 2 3 4 5 6 7
Translation Knowledge Questionnaire
Give your opinion in relation to the following statements
When I’m reading the source text, I’m already thinking about how to translate it.
This coincides with my opinion: Not at all □ a little □ a lot □ totally □
Words usually have different nuances of meaning in different languages, so something is lost in all translations.
This coincides with my opinion: Not at all □ a little □ a lot □ totally □
The same word can be translated in different ways depending on the text.
This coincides with my opinion: Not at all □ a little □ a lot □ totally □
Chart of Consultation CategoriesTYPE OR RESOURCE MEDIUM LANGUAGES IMPLIED1. General dictionaries 1. Paper 1. Source language2. Language reference works 2. Hard disk, diskette 2. Target languageand CD-Rom3. Field reference works 3. On-line 3. Bilingual4. Specialized dictionaries, glossaries 4. Multilingualand terminological data banks5. Parallel texts 5. Other language6. Searchers. Contextualized searchin searchers
- PACTE group has received support from the Spanish Ministerio de Educación y Cultura (1997-2000), the Ministerio de Ciencia y Tecnología (2001-2004) and the Generalitat de Catalunya (2002-2005).
- This based on the distinction made by Alves (1995, 1997).
- This based on the distinction made by Jakobsen (2002).
- The translator of the text from Spanish into German did not complete the task, which explains the difference in the number of T-solutions and L-solutions.
- Alves, F. (1995): Zwischen Schweigen und Sprechen: Wie bildet sich eine transkulturelle Brücke? Eine Analyse von Übersetzungsvorgängen zwischen portugiesischen und brasilianischen Übersetzern, Hamburg, Dr. Kovac.
- Alves, F (1997): “A formação de tradutores a partir de uma abordagem cognitiva: reflexões de um projeto de ensino,” TradTerm, Revista do Centro Interdepartamental de Tradução e Terminologia, 4-2, p. 19-40.
- Jakobsen, A.L. (2002): “Orientation, Segmentation, and Revision in Translation,” in Hansen, G. (ed.). Empirical Translation Studies: Process and Product. Copenhagen Studies in Language Series 2,. Copenhagen, Samfundslitteratur, p. 191-204.
- Neuzig, W. (2000): “The Computer in Empirical Studies for the Didactics of Translation,” in A. Beeby, D. Ensinger, M. Presas, M. (eds.): Investigating Translation, Amsterdam, John Benjamins Publishing Company, p. 91-99.
- PACTE (1998a): “La competencia traductora y su aprendizaje: Objetivos, hipótesis y metodología de un proyecto de investigación,” IV Congrés Internacional sobre Traducció, Universitat Autònoma de Barcelona (poster).
- PACTE (1998b): “Procesos de aprendizaje y evaluación en la adquisición de la competencia traductora,” European Society for Translation Studies – Congress Granada 1998, Granada.
- PACTE (2000): “Acquiring Translation Competence: Hypotheses and Methodological Problems in a Research Project,” in A. Beeby, D. Ensinger, M. Presas (eds.) Investigating Translation, Amsterdam, John Benjamins, p. 99-106.
- PACTE (2001): “La Competencia traductora y su adquisición,” Quaderns. Revista de Traducció, 6, p. 39-45.
- PACTE (2002): “Exploratory Tests in a Study of Translation Competence,” Conference Interpretation and Translation, 4-2, p. 41-69.
- PACTE (2003): “Building a Translation Competence Model,” in Alves, F. (ed.) Triangulating Translation: Perspectives in Process Oriented Research, Amsterdam, John Benjamins, p. 43-66.