Article body

This article presents the research carried out at the Faculty of Translation and Interpreting at the Universitat Autònoma de Barcelona (UAB) to evaluate how prepared its postgraduates were for employment. First, students were given an initial test to evaluate their competences related to knowledge, skills and attitudes with regard to occupational integration. Next, an improvement program was designed, implemented and evaluated. Finally, a posttest was given and we compared the results of the pretest and the posttest. The article describes the whole research project in eight steps. First, we briefly present previous research done within translation studies on career orientation and occupational integration. Second, we present the justification for the research. Third, our research objectives and hypothesis are established. Fourth, we explain the general methodology and the experiment design. Fifth, we describe how we measured the results. Sixth, we explain how we implemented our research and analysed the data. Seventh, we comment on the results. And eighth, we present our conclusions.

1. State of the question

Since translation is a profession with a long history and the main employment perspective for a graduate in Translation and Interpreting is to become a translator or interpreter, it seems reasonable to assume that there must be substantial research done on Translation Studies to help graduates become professional translators. There is indeed considerable research, but in analysing the existing literature we found that some aspects in the field are more developed than others. Some authors focus on the knowledge necessary to break into the profession (Díaz Ferrero and Sabio 2003; Samuelsson-Brown 1998; Valero 2003; Wagner, Bench et al. 2002; Sofer 2004; Tolnai 2008). Some focus on market description and market requirements (Carsten 2002; Gouadec 2002; Groethuysen 2002; Gromová and Müglová 2003; Waliczek 2002; Roser 2004; Wills 1999; Phillips 1996; Chaballe and Klein 1994; Jiménez 2002; Monzó 2002; Díaz Cintas 2003; Chaume 2003; Parra 2002; Aubert 1995; Aguilar Río 2004; Ulrych 1996; Casas-Tost and Rovira-Esteva 2008; Fišer 2008; Lung Jan Chan 2010). Some researchers have studied professional translators’ profiles and their qualifications (PACTE Group 2001; 2002; 2005; Asadi and Séguinot 2005; Tirkkonen-Condit 2005; Willss 1996; Kiraly 2000; Robinson 1997; McDonough 2007; Katan 2009; Dam and Korning Zethsen 2009). Still other authors, such as Bowker (2004), have analysed job offers for translators in order to include market demands in translators’ training. On the other hand, some studies focus on job placement and students (Kelly 2004; ANECA 2004; Observatori Ocupacional UJI 2003; OPQ 2003; Wagner, Bench et al. 2002). Other authors focus on developing skills for job placement (Byrne 2003; Teichman 2003; Ulrych 1996). Finally, some authors, such as Wakabayashi (2002) and Alcina-Caudet (2003), focus on developing the right attitudes for occupational integration. This last category could include real-life translation projects, enabling students to develop the knowledge and attitudes needed to become professionals. Such projects include simulations and direct professional experience (Lavault-Olléon 1998), simulations of the translator’s workstation (Borja, Gamero Pérez et al. 1998) and the Tradutech project (Gouadec 2003),[1] which involved more than thirteen European universities and included all aspects of technical translation training, from basic training to the final integration into employment. As stated in the project presentation: “L’enseignement débouche ainsi directement sur la profession en introduisant graduellement l’étudiant dans son milieu professionnel. Il s’agit en quelque sorte d’un continuum Centre de formation – Emploi” (Gouadec 2003).

As we can see from the above-mentioned works, the market is one of the aspects most studied by researchers. However, our research is based on less-studied aspects such as the process of orientation for employment, which lies somewhere between the research on the market and research on translators’ training. Occupational integration training deals specifically with the preparation of students for integration into the translation market, which is the missing link between postgraduates and the market (Torres-Hostench 2010).

2. Justification for the research

Although traditionally occupational integration rate of graduates in translation and interpreting in Spain has been high (see Table 1), there is also some unemployment.

Table 1

Employability of translation and interpreting graduates in Spain

Employability of translation and interpreting graduates in Spain
Sources: various sources between 1999 and 2003. See Note 2

-> See the list of tables

For instance, the UJI data included answers from the unemployed graduates (6.3%), who gave as their main reason for being unemployed the fact that they had not studied a specialized master’s course in translation after graduation, the financial crisis, and their lack of contacts. Nevertheless, not all employed graduates work in the translation sector, as seen in Table 2 below.

Table 2

Employment sectors of translation and interpreting graduates

Employment sectors of translation and interpreting graduates
  • Translation comprised the following jobs: freelance translator, translation project manager, translator in a language industry company or in another kind of company;

  • Language teaching comprised language teachers in private as well as public schools and/or universities;

  • Administrative jobs comprised administrative staff, secretaries, import-export employees;

  • Interpreting comprised conference interpreters, social and cultural mediators and court interpreters;

  • Others comprised receptionists, public relations staff, salespersons, hostesses, call center staff, shop assistants, consultants (linguistic, pedagogic or commercial), services coordinators, computer technicians and those working in mass media and travel agencies.

Sources: various sources between 1999 and 2003. See Note 2

-> See the list of tables

As seen in Table 2 many graduates work in administrative and language-related professions (around 30%-40%) or in language teaching (20%), but not doing full-time translation tasks. In many cases, the change of career from translation to other occupations might be a personal decision. However, it seems that graduates who have jobs related to translation are more satisfied with them. For instance, in UAB/FTI Data, graduates had to rate between 1 and 7 their satisfaction with their current job. Translation jobs scored 5.14; Language teaching jobs scored 5; Others scored 4.63 and Administrative jobs scored 4.53.

It would be interesting to know how many real translation offers for translation graduates were available at the time of the study and the proportion between offers and graduates. This information was not analysed in the study and it cannot be presented here. In future similar research it would be interesting not only to record employment data (figures and profiles) but also to analyse available translation offers. Although we cannot provide information on offers, we do have information on how students got their jobs (Table 3). Contacts and referrals are main work sources. This may indicate that many translation offers are not often public but are transmitted from customers/companies to translators individually or via personal contacts.

Table 3

Forms of access to jobs

Forms of access to jobs
Sources: various sources between 1999 and 2003. See Note 2

-> See the list of tables

Up to 50% of UAB translation graduates find work through contacts and networking (OPQ 2003), but they do not make the most of other ways of finding work. Thus, it was our contention that the present research helped to improve job placement quality and uncovered new ways of accessing the profession, as well as explaining real translation market conditions to graduates.

Before concluding this section, we should make it clear that none of the questionnaires used to gather the data presented in the tables above explicitly referred to the orientation for occupational integration provided by faculties. The universities had a major interest in using the questionnaires to see whether the courses helped students in their future jobs and whether the knowledge and skills they learned were applicable to their jobs. But nothing was asked regarding orientation for students in finding their job. Clients have also mentioned this lack of and need for orientation for occupational integration (ANECA 2004).

We shall conclude this section by stating something that is rather obvious: it should come as no surprise that there is a lack of orientation for the occupational integration of graduates if no provision is made for this kind of training in course syllabuses. We thus created a global program for orientation for occupational integration that included defining the need and justification for orientation, establishing the objectives, presenting the theoretical models that would enable all the issues to be considered, and creating an application model that would enable the program to be introduced, with provision made for an ongoing, exhaustive evaluation process. This is certainly a very innovative approach that is very different from leaving orientation for occupational integration to chance.

The students who participated in the research project belonged to one of the following student profiles: those who were employed in other sectors and wanted to study the master’s course to find a job in translation; those working in translation who wanted to improve their specialised translation skills; and those who had graduated recently and still had not found work. In all cases, though, the main reason for studying the master’s course was to keep or find a job in translation.

3. Research objectives and hypothesis

We designed the research after carrying out a detailed analysis of the research context and identifying the needs of this context, i.e., the needs of postgraduate and master’s students in terms of occupational integration, as is further explained below. Besides interviewing experts on occupational integration and reviewing the literature on occupational integration within the framework of translation studies, we carried out an initial evaluation of the context in which we wanted to carry out our research. First, we analysed the content of the master’s courses to see what they were already doing on occupational integration besides offering translation internships. We also analysed the profiles of the coordinators, lecturers and students. Then, we interviewed the coordinators to find out exactly what their needs were in terms of occupational integration. In this analysis we already detected three general needs: first, students needed to improve their knowledge of the translation market; second, students needed to develop specific skills to find work; and third, they needed to be responsible for their occupational integration and devote some time to this task. Specific needs varied from one master’s course to another because each course offered different subjects and content related to the profession. Therefore, different actions should be undertaken for each master’s course, as will be presented later.

In order to transform the general needs into specific research objectives, different theoretical models related to occupational integration were studied and a reference model was chosen for our research. Montané’s model (1990) was chosen, since it includes factors and variables for occupational integration related not only to the professional market or the person looking for work, but also to the techniques and processes that should be developed in order to improve one’s training in occupational integration. As we were interested in improving students’ training, this model was especially useful. Moreover, it was easy to understand and to apply. Montané’s model suggests analysing:

  1. Knowledge for occupational integration, i.e., knowledge needed to get access to a desired job. In our case, it would imply information on where to get a translation job, how to access the translation market, etc.;

  2. Skills for occupational integration, i.e., skills to be mastered to succeed in a job recruitment process. For instance, how to prepare a CV for the translation market, how to prepare for an interview, how to approach a translation test, etc.;

  3. Attitudes for occupational integration, i.e., attitudes that are relevant when looking for work, such as dedication, flexibility, professional maturity and professional self-esteem.

All these factors will be explained in greater detail later.

Montané’s occupational integration model was complemented with quality models to organize research more accurately. The quality models reviewed were the ISO model, the EFQM Model and the Total Quality Management model, which are not described in this article as they are popular enough to be considered of general knowledge for researchers. Based on the general detected needs and Montané’s occupational integration model, a series of objectives was established. As a general objective, we decided that the training of postgraduates in occupational integration needed to be improved in order to achieve a change in their knowledge, skills and attitudes when looking for work. As specific objectives, we determined that students needed:

  1. to get information and know the real translation market in order to have a realistic view – objective inspired by Montané’s factor “knowledge for occupational integration”;

  2. to learn specific skills to succeed in the selection process for a translation job – an objective inspired by Montané’s factor “skills for occupational integration”;

  3. to improve specific attitudes for occupation, such as dedication – objective directly inspired by Montané’s factor “attitudes for occupational integration.”

We believed our objectives were realistic and could be encouraged in class. Of course, there are also other aspects involved in an employment process, but some depend exclusively on the postgraduates, such as their personality, their CV, etc., while others depend on the market, such as professionals’ competences or the number of employment offers available to postgraduates (which, as mentioned before, were not analysed). To achieve our objectives, we designed a training improvement program (hereinafter, the OIL Program). From the general objective we established a hypothesis that we would be able to confirm or reject at the end of the research. Our hypothesis was the following: with the OIL Program, postgraduates would improve their knowledge, skills and attitudes in occupational integration. The hypothesis validation as well as the OIL Program will be explained later in this article.

4. General methodology and experiment design

A total of 122 postgraduates from the Universitat Autònoma de Barcelona (Spain) took part in the experimental research carried out in 2005. They were distributed in five groups: three experimental groups and two control groups. The classification between experimental and control groups was made after the interviews with the master’s courses coordinators where they were informed about the research and the OIL Program. From a strictly scientific point of view, the five groups were adequate to be experimental as well as control groups. Each coordinator decided whether to participate as an experimental or control group depending on the support that could be offered to the research. As a matter of fact, from a statistical point of view, it would have been better to mix students from the five courses and distribute students in experimental and control groups randomly. However, this option did not allow coordinators to follow the progress of their groups individually, nor did it enable specific actions for each master’s course to be prepared, which was one of the objectives of the OIL Program. In the end, the groups were divided as shown in Table 4.

Table 4

Brief description of groups

Brief description of groups

-> See the list of tables

Ten lecturers from the five different master’s and postgraduate courses also participated in the OIL Program. Moreover, 90 students participated in the pilot experiment that took place the previous year. In total, more than 220 people were involved in this research project. The research followed a pretest-posttest design (Table 5) and some variables were identified (Table 6).

Table 5

Research design structure

Research design structure

-> See the list of tables

Table 6

Independent and dependent variables present in the research project

Independent and dependent variables present in the research project

-> See the list of tables

Independent variables are those variables manipulated by the researcher, i.e., those elements deliberately manipulated to test the results of the research. In our research, the first independent variable (IV1) is the OIL Program, as the results vary depending on the implementation of the program in each group. The second independent variable (IV2) are the lecturers, as they were the ones who applied the program to postgraduates. Section 7 explains how results were affected by different independent variables.

It is the dependent variables (elements and people’s behaviours) that are measured, as they are supposed to be changed by the independent variables. The first dependent variable (DV1) in our research is the OIL Program per se, as it is the first finished product obtained during the research. As we can see, the OIL Program can be either an independent or a dependent variable, depending on its function in the research. The second dependent variable (DV2) is the lecturers, as they too receive the program before passing it on to the students. Lecturers are therefore also both an independent and a dependent variable. The third dependent variable (DV3) is the postgraduates, who are evaluated in the posttest to check whether any changes have taken place since the beginning of the intervention. Alien variables are variation dimensions that may confuse the action of manipulated independent variables. In our research, alien variables are personal and professional features of the students, as well as the contents of master’s and postgraduate courses. In order to monitor them, we recorded them. All information produced during the research was properly recorded and saved. Table 7 summarizes the documentation used, produced and compiled during the research.

Table 7

Documentation used in the research

Documentation used in the research

-> See the list of tables

5. The instrument of measure: the pretest-posttest questionnaire

A pretest-posttest questionnaire was designed to measure the degree of postgraduates’ training in occupational integration. The questionnaire had 30 items that evaluated knowledge, skills and attitudes related to occupational-integration training, and a few preliminary items to define the personal profile of students and their employment situation. The Appendix contains the final version of the questionnaire. This instrument was validated by experts, and confidence levels were measured statistically using the Cronbach coefficient Alpha (0.741 for 32 items).

The pretest-posttest questionnaire we used in our research was adapted from two sources: Montané (1993: 166) and Pérez Escoda (1996: 156). The clearest difference between these two questionnaires and ours is that the former are addressed to anybody looking for a job, whereas ours is addressed specifically to translators, whether they are looking for a job in a company or self-employed work. As we shall see in the detailed description of the items in the questionnaire, the items are related to our research objectives and hypothesis: the improvement of knowledge, skills and attitudes for occupational integration in translation. Next there is a description of the questionnaire. The Appendix contains a final version of the questionnaire for reference. This pretest-posttest questionnaire has a double function. On the one hand it reveals students’ training in occupational integration (which is useful for us), while on the other it provides a tool to make students aware of what they do for their occupational integration (this function is very useful for them). It was difficult to choose only 30 indicators (this was the maximum we established in order to be able to control them properly), but we chose relevant indicators that not only were good examples of the knowledge, skills and attitudes we wanted to test, but also would be clear enough to make students think about their own occupational process after completing the questionnaire.

The first part of the questionnaire asks students to answer some general questions on their profile. This information is used to know the students better and to control alien variables. Students must write their name, age, the degree they studied before the postgraduate or master’s course, the year they finished their degree, the postgraduate or master’s course they are studying, their current employment, their desired employment, their experience in the job and general information on their work experience.

The second part of the questionnaire is designed to evaluate knowledge on occupational integration. Students have to answer whether they know what translation customers offer, and what they ask from a translator, what the legal and fiscal obligations are, and if they know any free employment services where they live.

The third part of the questionnaire contains items that evaluate skills in occupational integration. The degree of expertise is evaluated using the following indicators: having a professional website, having and distributing marketing material, having a plan or strategy to look for clients, knowing how to find employment or translation work, knowing how to sell translation services, and knowing how to keep clients satisfied. Some questions are too general or subjective, such as number 9 (Do you know how to sell translation services to a new client?) or 10 (Do you know how to keep clients satisfied?). We are interested here in the student’s perception of this issue, not in specific answers. If they feel they are able to sell services or satisfy clients, it means they feel they have the specific skills to do so (in this section we are testing skills), whereas if they feel they are not ready to deal with clients, hopefully, at the end of the test, they would think that they should do something about it so that they would be more open to the OIL program, for instance.

In the fourth part of the questionnaire, students answer some questions on dedication to occupational integration. This serves to evaluate the university degree of activity in the following areas: contacting companies personally or by phone in the last 30 days, sending curriculum vitae or answering translation offers in the last 30 days, having translation tests or interviews pending, how much time students devote to occupational integration and if they would go to an occupational integration course.

The fifth part of the questionnaire is about flexibility in occupational integration, i.e., whether students would be flexible regarding working conditions. For example, whether they would accept a similar translation job to the desired job, whether they would accept lower rates or working in lower working conditions than expected, whether they would accept working somewhere other than they expect and whether they would accept irregular working hours.

The sixth part of the questionnaire evaluates professional maturity, i.e., the student’s capacity to be really interested in a job and to value the pros and cons of a job. In this area, students were asked whether what they read is related to their profession, whether they are members of professional associations, whether they are technologically prepared and whether the reason for studying the master’s or postgraduate course is to look for a translation job or for other reasons.

The last part of the questionnaire is about professional self-esteem. In order to evaluate professional self-esteem students answer questions on their own perception as professionals, such as the professional perception they think that their friends and colleagues have of them, their own perception of being able to offer added value to their translation services, their own perception on the possibilities of finding work, their determination when looking for work and their optimism or pessimism when looking for work.

Each item had three or four possible answers (depending on the item). Each answer was converted to a numeric value from 0 to 2. Items with three possible answers were converted to a 0, 1 or 2 value and items with four possible answers were converted to a 0, 1, 1.5 or 2 value. This allowed us to compare values at the end of the research between groups, as presented in section 7 (“Global Results”).

The pretest questionnaire was given to the pilot group of 90 students in January 2004 from four master’s courses (Audiovisual Translation, Legal Translation, Translation and New Technologies, and Literary Translation). In the pilot test students were different from students from control and experimental groups. In this pilot test the validity of the instrument of measurement and the appropriateness of the research were tested. Based on the results we made some minor changes to the design, implementation and assessment method for the questionnaire.

6. Implementation and data analysis

In the experiment in 2005, the pretest was given to 122 participants (control groups and experimental groups). During the pretest, notes were taken on technical problems and any other significant information, whether positive or negative, to improve the pretest for future editions. Afterwards, the pretest data were processed and, based on the results, the lecturers and the research coordinator designed a series of activities to improve the results. For the improvement program, specific material was designed and up to ten lecturers cooperated by preparing their own material. The improvement program was implemented in class so that lecturers of the postgraduate and master’s courses, most of whom are also professionals in the translation market, indirectly trained students in occupational integration in their courses. Finally, the posttest questionnaire (which was the same as the pretest questionnaire) was given to the students in order to compare its results with the pretest results.

The results of the posttest were analysed by comparing the experimental groups and control groups to find out whether there were actually any changes in postgraduates’ knowledge, skills and attitudes related to occupational integration since the program had been implemented. The results were processed with the statistical software SPSS. Specific results according to each of the questionnaire’s items and by group were also analysed in the research and given to each master’s course coordinator for their reference.

In order to clarify duties and responsibilities for different participants of the research, Figure 1 gives a graphical representation of the relationships established between participants and a list of each participant’s duties and responsibilities.

Figure 1

Relationship between participants

Relationship between participants

-> See the list of figures

The research supervisors’ main responsibility was to provide advice on the design, implementation and evaluation phases of the research.

The responsibilities of the research coordinator were: designing research from analysed models taking into account the context; informing participants about research and the OIL Program; encouraging and motivating master’s courses coordinators, lecturers and students to participate; elaborating research materials and OIL Program; recopilating and analysing data and materials for research and for the OIL Program; preparing research reports; managing OIL Program activities; evaluating the research and the OIL Program with participants and, last but not least, disseminating the results.

Among responsibilities of master’s courses coordinators were accepting and supporting the research; informing lecturers and students about the OIL Program and evaluating the OIL Program with the research coordinator (design and implementation).

Lecturers’ main responsibilities were familiarizing themselves with the research and supporting it; implementing OIL activities in their classes; encouraging students to participate; and evaluating the OIL program with the research coordinator.

As for students, they were expected to participate actively in the research (completing the pretest and posttest questionnaires, completing OIL activities and evaluating the OIL Program).

Table 8 details the timing for the pilot groups and Table 9, the timing for the experimental groups.

Table 8

Implementation for the pilot groups

Implementation for the pilot groups

-> See the list of tables

Table 9

Implementation for the experimental groups

Implementation for the experimental groups

-> See the list of tables

6.1. The OIL Program

The OIL Program consisted of the OIL Dossier prepared by the research coordinator and OIL activities implemented by lecturers in class.

6.1.1. The OIL Dossier

The OIL Dossier consisted of 40 activities distributed in five units that students could carry out. To encourage participation at the beginning of the program, students did not receive the five units from the beginning. They would do the activities for one unit, send an evaluation questionnaire to the research coordinator and, once the questionnaire was received, the following unit was sent to the student. The first unit was sent in November. As the participation in the Program was voluntary, not all students participated (from the three experimental groups, in one group students participated just in one unit, in another group students participated in two units, and in the third group students participated in four out of five units). In February, once the final statistical results from the pretest were available, a full version of the Dossier was sent to students to give them a second chance to participate and a brief OIL Dossier evaluation questionnaire was sent to students to check if students had done the activities, and their opinions.

It is worth mentioning that the group in which students participated in the five units had higher posttest results than the other groups, so there is a direct relationship between active participation in the OIL Dossier and the final results of the group. Moreover, students who completed the OIL Dossier valued it positively as a tool for occupational integration.

The OIL dossier is useful for students if they produce the dossier themselves, and is useful for lecturers if they want to do some of the activities in groups in class.

The OIL dossier contains five topics:

  1. The idea of the professional project;

  2. Web and e-mail addresses I’m interested in;

  3. The distance marketing campaign;

  4. Direct contact: telephone and interviews;

  5. Creating an action plan.

The order of the topics is coherent with the logical progression of the search for a job. Most of the activities are related to one of the items in the occupational integration questionnaire and aim to improve the results of the questionnaire. The first version of the OIL dossier was produced based on the results of the questionnaires in the pilot study.

The activities in the first topic, entitled “The idea of the professional project,” deal with the general approach to the professional project and defining the job the student is seeking. This idea is related to the student’s personal profile and certain elements of the labour market, such as competence, so students can redefine their employment objectives and make it more realistic. The proposed activities and reflections are as follows:

In activity 1.1, entitled The job I’m looking for, students define the jobs they want in as much detail as possible so they can identify information they lack and what they need to ask. In this activity, students work on maturity for employment. In activity 1.2, entitled The job ad I’m looking for, students say what specific job they want. This exercise enables students to clearly state their objectives. In activity 1.3, entitled The clients I’m interested in, students establish what clients they want to work with. This activity also focuses on students’ maturity for employment. In activity 1.4, entitled In the client’s shoes, students identify what translation services clients of interest may ask for. Students also work on their knowledge of occupational integration in this activity. In activity 1.5, entitled You and the client, students consider how they can improve the services they offer clients to gain a competitive edge. In this activity, students work on various attitudes, including professional self-esteem. In activity 1.6, entitled The benefits of the job, students analyse the job they want to do in greater detail. In this activity, students work on maturity for employment. In activity 1.7, entitled The opportunities and threats of my profile, students analyse the strengths and weaknesses of their profile. This information helps them to adjust their choice of job, if necessary. In this activity, students work on maturity for employment and professional self-esteem. In activity 1.8, entitled What makes you different from your competitors, students become aware of the concept of competition and incorporate measures into their action plan to deal with competition. In this activity, students work on maturity for employment.

Once the professional objective has been clarified, the second topic is introduced. Entitled Web and e-mail addresses I’m interested in, it aims to enable students to gather together the addresses they need to achieve their objective. In this phase, students do not contact clients. They simply compile the necessary information. In activity 2.1, entitled Translators’ associations, students find out about the different translators’ associations and consider whether they should join an association. In this activity, students work on maturity for employment. In activity 2.2, entitled Occupational integration paths, students explore the different occupational integration paths they can use to reach the clients they are interested in. Students work on their knowledge of occupational integration in this activity. In activity 2.3, entitled My register of addresses, students produce a single document containing the addresses they have so they can subsequently contact potential clients. Students work on their occupational integration skills in this activity. In activity 2.4, entitled New addresses, students produce a register of addresses of companies they would like to contact. Students work on their occupational integration skills in this activity. In activity 2.5, entitled Improving networking, students become aware of the importance of contacts when looking for work. In this activity, students work on maturity for employment and knowledge of occupational integration.

Once students know what they want to do and have the addresses they need, their next step is to produce the promotional material they want to send to their potential clients. The activities in the third topic, entitled The distance marketing campaign, are preceded by a short introduction on promotional material. In activity 3.1, entitled The website, students become aware of the importance of a website to professional translators. Students are given some advice on designing a website. In this activity, students work on maturity for employment and occupational integration skills. In activity 3.2, entitled The business card, students produce a business card. Students work on their occupational integration skills in this activity. In activity 3.3, entitled The résumé, students learn how to produce a résumé. Students work on their occupational integration skills in this activity. In activity 3.4, entitled The cover letter, students learn how to write a cover letter. Students work on their occupational integration knowledge and skills in this activity.

Once students have established what type of job they want (first topic), gathered together the addresses of contacts and companies related to that type of job (second topic), and prepared the distance marketing material (third topic), they must then prepare for directly contacting potential clients in the fourth topic, entitled Direct contact by telephone and in interviews. Activities 4.1 to 4.6, entitled Contact by telephone, give students preparation and practice for their first contact with potential clients. Students work on their occupational integration knowledge and skills in this activity. In activities 4.7, 4.8 and 4.9, entitled Preparing for interviews, students practice basic strategies to prepare for an initial interview with possible clients. Students work on their occupational integration knowledge and skills in these activities. In activity 4.10, entitled The interview, students receive strategic advice on holding an initial interview with a potential client. Students work on their occupational integration knowledge and skills in this activity.

In the fifth topic, entitled Creating an action plan, students must produce an action plan with a detailed schedule, since everything else is now ready: the choice of potential clients (first topic), the addresses (second topic), the promotional material (third topic) and the strategies for the initial contact (fourth topic). The activities in this topic aim to help students in the area of work commitment. A week-long action programme is prepared, the contacts established are followed up, the action programme is reviewed and the unachieved objectives are analysed.

6.1.2. Activities done by lecturers

Lecturers volunteering to participate could choose an activity from a menu of occupation activities prepared by the research coordinator and/or prepare their own activities with the support of the research coordinator.

Table 10 provides a summary of the activities done by lecturers in each group. It is worth mentioning that although the program is the same for all groups, some activities were different because lecturers could choose the activities taking into account the students, the subject, etc. This freedom to choose is positive for the program’s success as it allows customization of contents.

Table 10

Activities done by lecturers in experimental groups

Activities done by lecturers in experimental groups

-> See the list of tables

In the evaluation of the OIL Program, students valued activities done by lecturers positively. The highest ++score was for Translation and New Technologies activities, probably because these activities were more related to the master’s course contents. Lecturers also valued positively the activities and some mentioned as ideas for improvement to integrate more of these activities in the master’s course subjects and devote more time to this content. Some lecturers commented that they see many students are lost and do not make the most of the resources that they and/or the master’s course offers to them. The direct approach of the OIL Program could help to address this situation.

7. Global results

This section presents the statistical results of the experimental stage. They will show whether postgraduates (dependent variable) have been affected by the OIL Program consisting of the OIL Dossier and activities prepared by lectures (independent variables). There are no global results for the pilot test. We only have the pretest results, which were used to refine the questionnaire, identify the items with the lowest score and prepare the OIL Dossier accordingly. It is worth mentioning that pilot pretest results coincided mostly with the results in the experimental stage.

In the experimental stage, from the pretest-posttest questionnaires we extracted an overall average score of between 0 and 2, as explained in the presentation of the questionnaire. The global average for all the pretest answers was 0.88 and the global average for all posttest answers was 1.03. The global averages are represented in Figure 2. There was only a small difference of 0.15 between the pretest and posttest average.

Figure 2

Comparison between global pretest and posttest averages

Comparison between global pretest and posttest averages

-> See the list of figures

In Figure 3 we can see a comparison between the global averages of the experimental groups (pretest 0.93 and posttest 1.09) and the control groups (pretest 0.80 and posttest 0.91). The global average shows little change between the pretest and posttest stage. However, there are clearer differences between groups and between specific items.

Figure 3

Comparison between global pretest and posttest averages in experimental and control groups

Comparison between global pretest and posttest averages in experimental and control groups

-> See the list of figures

Differences in averages by group are clearer, as can be seen in Figure 3. If we order the groups by their differences between pretest and posttest results, we can see that there are greater differences between pretest and posttest results in experimental groups and fewer differences in control groups. The classification by groups can be seen in Figure 3. Interestingly, as we will see later in this paper, in the master’s in Translation and New Technologies, which had the highest score, students and lecturers were more active in the improvement program (there were more activities with lecturers and more students completed more units of the OIL dossier).

Table 11

Results by group

Results by group

-> See the list of tables

Figure 4

Comparison between global pretest and posttest averages by group

Comparison between global pretest and posttest averages by group

-> See the list of figures

7.1. Results on knowledge of occupational integration

Items belonging to the area of knowledge on occupational integration have the highest results in the questionnaires. The results reveal that after studying a master’s or postgraduate course, participants increase their knowledge of occupational integration, i. e., they have more information (“knowledge” understood as a synonym of “information”). The students’ main concern during the master’s course as for occupational integration is their lack of knowledge, and this is the first issue they want to address, and indeed they do address, during the master’s course. In particular, they do not know about legal and fiscal issues, what clients want and what they offer, and so on. Students are very interested in discovering how the translation market works. Control groups show high results in this area. The highest score is for legal and fiscal issues presented in the master’s and postgraduate courses. The lowest score is related to knowledge of free job centres outside university. This means that students pay attention to what the course offers them but they do not seek employment orientation outside their university course. After the master’s or postgraduate course the identified need is satisfied and the objective is achieved because students know the professional market better. Improvement in this area may not be specifically a result of the OIL program but rather a result of specific content in the master’s and postgraduate courses. However, the research is useful for the master’s and postgraduate coordinators, because they had no previous recorded information about this issue.

Figure 5

Comparison between global pretest and posttest average on knowledge, global results and results by groups

A

B

-> See the list of figures

The global pretest average for knowledge was 0.56, and the global posttest average was 1.03. The difference between pretest and posttest is much greater than in other areas, as it is the area that interests students the most. As seen in Figure 5B, the posttest average was significantly higher than the pretest average in all groups.

7.2. Results on occupational integration skills

In the skills areas there were greater differences in the results of control and experimental groups. This is precisely the area most influenced by the OIL improvement program. The lowest results are related to the active skills that require a proactive approach, such as creating a professional website or marketing oneself. In this area there were fewer differences in the averages between the control groups and the experimental groups. The clearest differences in skills development between groups are related to more passive skills or skills related to knowledge. New knowledge acquired during the master’s course appears to have stimulated the development of related skills, such as drawing up a plan to look for work – if students have better knowledge of prospective clients and the translation market in general it is easier for them to produce a plan – and marketing one’s skills to acquire new clients and make existing clients loyal. Interestingly, the more participative groups in the OIL program obtained higher results in the skills area because the OIL Program and activities with lecturers focused on improving skills. The results are as follows:

Figure 6

Comparison between pretest and posttest average on skills, global results and results by groups

A

B

-> See the list of figures

In the skills area, the global average increased from 0.34 (pretest) to 0.67 (posttest), as seen in Figure 6A. In this area there was a notable change in the Audiovisual Translation group, together with the other two experimental groups.

7.3. Results for attitudes related to occupational integration

In our initial evaluation, we identified the need to increase the time dedicated to finding work, and this was a specific aim of the improvement program. Specific activities strongly emphasised this aim as it was one with the lowest score in the pretest. In the posttest, very low results were observed (almost no difference between pretest and posttest), even though the more active group in the OIL improvement program scored higher than other groups that were not very involved in the improvement program. It might be that students were not interested in finding a job until they finish the master’s course, or they had not time to devote to finding a job. Another reason may be that the program was not compulsory. Whatever the reason, we can say that increasing dedication to occupational integration was one of the aims of the program and it was not achieved the way we expected. Nevertheless, in later editions of the master’s courses some contents on occupational integration were included and students would devote time to these contents as part of the master’s course, which is more effective.

Another of the needs detected in the pretest was the improvement of professional maturity in the sense of professionals’ will to improve their professional skills. In this area we observed an improvement in those areas already included in the master’s course, such as reading about the profession. Between pretest and posttest there was an increase in the number of memberships of professional translators’ associations, which is also a sign of professional maturity. For the attitude indicator “self-esteem,” neither in the pretest nor in the preliminary context analysis did we observe the need for improvement, because the initial results were good. The final results show a small, but not significant improvement in self-esteem. Figures 7A and 7B show the global and group results.

Figure 7

Comparison between pretest and posttest average in attitudes, global results and results by groups

A

B

-> See the list of figures

8. Conclusion

This research was useful in providing empirical data on the training for occupational integration that postgraduates receive during their postgraduate or master’s courses. It also served to improve training already present in the courses. Moreover, the research introduced a working methodology for cross-sectional content into the master’s and postgraduate courses, i.e., special programs, such as the occupational integration OIL Program. Regarding participation, while the lecturers’ opinion of the experience was so positive that they were willing to include more activities related to occupational integration, students’ participation in the research was voluntary, and we found that some of them did not take it too seriously.

The control groups showed very low results in the posttest in skills and attitudes. After the improvement program, the experimental groups’ results showed an improvement in skills and attitudes, although their scores were not much higher. Improvement in knowledge is easier to achieve: before the master’s course, a student “did not know,” and after, the same student “does know.” However, improvement in skills and attitudes is more difficult to achieve, even when a specific improvement program and activities are implemented, because they are related to “doing” and changing personal attitudes and beliefs.

In conclusion, knowledge on the market is not the only factor to take into account when looking for translation work. Unless postgraduates also develop the right skills and attitudes, which can be very difficult to develop, their chances of finding work will not improve. They need to combine knowledge, skills and attitudes, and find the right balance between the three. After the research our recommendation was to incorporate compulsory content to develop students’ specific skills and attitudes into their master’s and postgraduate courses, since these areas had the lowest results in the research. We made this recommendation to the master’s and postgraduate course coordinators, and since 2006 specific content on occupational integration has been included in the syllabuses of four of the five courses (the postgraduate course in literary translation is no longer offered). Further research will be done on employment data after the inclusion of compulsory contents on occupational integration in the syllabus.