Journal Archives

New. Renew. Energy - Vol. 11 , No. 4

[ Article ]
New & Renewable Energy - Vol. 11, No. 4, pp. 4-18
Abbreviation: New & Renewable Energy
ISSN: 1738-3935 (Print)
Print publication date Dec 2015
Received 02 Jun 2015 Revised 12 Nov 2015 Accepted 17 Nov 2015
DOI: https://doi.org/10.7849/ksnre.2015.12.11.4.4

Efficiency Analysis of R&D Productivity within the Korean Renewable Energy Technology Sector
Mina Lee1)
1)Laboratory of Global Environmental Policy, Graduate School of Global Environmental Studies (GSGES), Kyoto University, Tel: +81-90-6551-8558 (lee.mina.24a@st.kyoto-u.ac.jp)


Copyright ⓒ2015 by the New & Renewable Energy
This is an Open Access article distributed under the terms of the Creative Commons Attribution Non-Commercial License (http://creativecommons.org/licenses/by-nc/3.0) which permits unrestricted non-commercial use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

In Korea, the bulk of investment in research and development within the renewable energy sector is channeled towards technologies which are close to commercialization. In addition, the majority of financial support from government agencies reflects an investment in firms, rather than universities or small firms. However, the performance, in terms of market share and price competitiveness, of Korean renewable energy technology is still very low in the overseas market. There remains a greater amount of R&D investment is received by large firms rather than smaller firms. However, it has not been shown that the R&D efficiency of larger firms is greater than that of smaller firms.

The paper estimates that a productivity of 1340 R&D projects from 2008 to 2012 in renewable energy technology by performers and by technical progress phase using output-oriented BCC modelling in Data Envelopment Analysis (DEA). The results reveal that the efficiency of basic R&D research is higher in universities and institutes, while the efficiency achieved in applied research is higher within larger firms. However, the efficiencies achieved in development research is low in general, regardless of whether the R&D is carried out in a large firm, smaller form or university.


Keywords: Korea, New and Renewable energy, R&D Productivity, Efficiency frontier, Data Envelopment Analysis (DEA)

1. Introduction

A policy of support for renewable energies was firstly introduced in the “Alternative Energy Development Promotion Act” in 1987 in light of concerns over Korea’s energy security as a country that depends highly on imported fossil fuels and various environmental problems due to climate change. The support has been strengthened as of the “2nd act on the promotion of development, use and diffusion of new and renewable energy” implemented in 2003. This occurred again in 2008, when “Low Carbon and Green Growth” was proclaimed as the nation’s vision to lead development during the next 50 years and the “National Strategy for Green Growth” was announced to mitigate climate change, to create new engines for economic growth, and to improve the quality of life. The renewable energy support policies are classified largely into “research and development (R&D)”, “diffusion”, and “industry promotion” and this paper particularly focuses on the R&D fields.

1.1 Korea renewable energy technology R&D

The first legal effort into technology development in renewables was discovered in 1987, enacting “Alternative Energy Development Promotion Act” to carry forward renewables’ technology development as well as start commercializing and diffusing solar-thermal and waste energies after oil crises occurred twice in the 1970s. Currently, the government specifies eight renewable energies (photovoltaic, solar-thermal, wind energy, bioenergy [including combustible renewables], ocean energy, geothermal, hydropower, and wastes [including industrial waste]) and three new energies (fuel cell, hydrogen, and integrated gasification combined cycle (IGCC; hereafter, referred to as renewable energy]) to promote based on the “Act on the promotion of development, use and diffusion of new and renewable energy” since 1997, and the act has been revised three times until now. The current 4th act, announced in September 2014, is aiming at increasing the use of renewable energies to 11% of total primary energy supply (TPES).

Financial support for R&D activities in renewables has been given since 1988, and its total R&D investment combined by government and private sectors until 2013 is KRW 3.71 trillion (USD 3.71 billion if USD 1 = KRW 1,000), which increased especially sharply in the last decade from 2004 to 2013 at a 25% average annual growth rate. The support in 2010 and 2011 accounted for 6.07% and 4.92% respectively out of IEA countries’ renewable energy R&D expenditure.[1,2] Despite the current bold renewable energy R&D investment policy, absolute total investment during the last few decades is regarded as far behind those of other countries like the United States, Germany, France, Japan, and the United Kingdom.

The R&D tasks are strategically divided into short-term tasks for technologies with potential to be commercialized in the near future and medium- and long-term tasks performed in order to acquire future core technology. In the short-term tasks, the pragmatic technologies, like photovoltaic (PV), wind energy, and fuel cell, which can be utilized for current early diffusion by lowering electricity generation cost, supporting commercialization and overseas market expansion, and linking R&D with diffusion policy, are subjected preferentially to a heavy investment. PV received the most R&D investment among the eleven renewable energies both in number of projects and in amount of financial investment: 275 projects accounting for KRW 777.2 billion in R&D investment for new and continuous projects. Fuel cell and wind power are the next, representing 120 and 127 new projects, respectively, and KRW 747.38 billion and KRW 513.36 billion, respectively, in R&D investment for new and continuous projects.[3] These three energies, which are designated as priority supporting energies, account for 54.95% of total renewable R&D investment.

R&D activity can be also classified according to performer (university, research institute, and large and smaller firm) or its technical progress phases (basic, applied, and development). By technical progress phase, as shown in Fig. 1, 759 new and continuous R&D projects took place on development phase, which accounts for nearly 70% of total R&D projects, gaining the most financial support, of KRW 556,431.7 million, between 2008–È2012.[4] The research on the development phase was mostly carried out by large and smaller firms and basic and applied researches by universities and institutes.


Fig. 1. 
Renewable energy R&D support by technical progress phase from 2008-2012 (Source; NTIS www.ntis.go.kr)

Fig. 2. shows a trend in R&D investment from 2008–2012 by performer, and the large firms are taking the most advantage of R&D investment among beneficiaries, representing nearly half of the R&D of KRW 243,223.38 (54.01%) from 2008 to 2012, while others like smaller firms, institutes, and universities received KRW 147,461.80 (32.75%), KRW 43,313.50 (9.62%), and KRW 16,311.64 (3.62%) respectively during the same period.[5]1)


Fig. 2. 
Renewable energy R&D support by perfroermes from 2008-2012 (Source; NTIS www.ntis.go.kr)

While public R&D investment in renewable energy technology has decreased in recent years, with KRW 277,304 million in 2012, KRW 271,963 million in 2013, and KRW 249,305 million in 2014,[6] the investment trend in terms of average amount per project is getting larger, and considerable R&D investment is still being delivered into large firms whose research is mainly big and on the development phase that can generate economical profits in the short term and focus on a system field that includes activities such as standardization, planning, demonstration, operation, performance evaluation, and so on.

In this context, the approach of delivering heavy investment to large firms may need to be reconsidered. As firms grow large, efficiency in R&D is weakened due to the loss of managerial control or excessive bureaucratic control as well as the incentives of individual researchers being weakened due to decreasing their ability to capture the benefits from their individual efforts or conservative characteristics of the hierarchies of large firms that may frustrate their creativity.[7]

However, there are distinctive benefits that favor the large firms over the smaller firms.[8] For instance, the large firms are able to conduct risky R&D in an imperfect capital market by utilizing their internally generated funds, which are more available and stable as firms grow and provide economies of scale to reduce the risk associated with the prospective return from R&D activity. In addition, there are economies of scale in R&D activity and the returns from R&D are higher in firms that have a larger volume of sales that can be used to spread out the fixed cost generated during R&D activity.

In Korea, the selectively concentrated R&D investment on large firms that conduct systematic researches mostly on development phase in order to achieve a short-term diffusion goal may slow development in core technology development on components, equipment, and materials in which smaller firms are interested.[9] For instance, the industrial import dependency in the PV module, a core component for PV, is highly dependent on import (46.6% in 2008) because of the lack of reliability, the shortage of skill, low price competitiveness, and so on.[10] Moreover, the import dependency in wind energy power plant installed in the country was 99.6% in 2008, since the generating firms prefer the foreign product due to the low technological competitiveness in supporting core components and materials in charge of domestic smaller firms.[11,12]

Despite extensive efforts in R&D since 2008 to catch up with advanced technology, the level of commercialization derived from technology supported by Korean R&D activity and export of domestic goods (that is considerably important for Korea whose domestic renewable energy market was only 0.5% of the global market in 2011) remain sluggish. This is largely due to the lack of core technology needed to lead in the international market. The Korean market share in the international renewable energy technology was 0.27% in 2012, increased slightly compared to 0.18% in 2008.[13] Sales in renewables were KRW 3,268 billion in 2008 and increased to KRW 7,515 in 2013; exports were USD 1,706 million in 2008 and increased to USD 4,770 million in 2011; this trend then entered a downturn, with USD 2,523 million in 2012.[14]

1.2 Previous researches on Korea renewable energy technology R&D

There have been several quantitative and qualitative analyses on renewable energy R&D productivities in Korea. Korea still has a lower interest in R&D investment in renewable energy technology compared to other OECD countries under the condition that GDP per capita is excluded due to R&D increasing as GDP increases.[15] It seems that return on R&D is becoming more visible in sales and export along with recent R&D increases, especially in PV and wind energy technology; however, the technologies are not yet sufficient to compete in the international market, and the requisite R&D has been lacking, partly due to a lack of national R&D support.[16]

As results of quantitative research, the extended R&D support in renewable energy technology would be desirable in Korea to increase GDP.[17] The efficiencies of renewable energy R&D in terms of paper, patent, and engineering fee increased yearly as well as being shown to be comparatively more efficient than other energy programs such as nuclear energy.[18] By energy source, wind power is shown to be the most efficient in terms of the government support including R&D and promotion compared to other renewables such as fuel cells and PV.[19] On the other hand, it has been also shown that if renewable energy R&D performance described representatively as paper and patent are relative to the economical value, stability, profitability, growth, and innovation in firms who received R&D support to spend for renewable energy technology are not increased significantly compared to the firms that did not receive R&D support. This indicates that R&D support in renewable energies is not being connected to the firms’ performance by technical commercialization.[20]

The results of research may be interpreted variously according to analysis methodology and research purpose, but there is not doubt that the aim for R&D activity is to achieve profits in the future. The concept of productivity is naturally valid in the renewable energy technology that is regarded to be significant as a future growth engine for Korea, and it is important to assess and enhance the R&D productivity in a qualitative way beyond quantitative growth. However, there have been no empirical studies to estimate Korea R&D productivity in renewable energy technology by performers (larger and smaller firms as well as institutes and universities) that are playing an essential role in conducting public R&D activity as well as by technical phases (basic, applied and development) whose purpose to perform are dissimilar one another.


2. Empirical studies on the Schumpeterian hypotheses

The technical change can occur in two directions, technology-push and demand-pull. The studies on the role of science and technology-push emphasize that technological advance will lead and determine the rate and direction of innovation.[21,22] On the other hand, the counterpart studies claimed that market demand drives innovation, creating opportunities for firms to invest more in safe innovative activities that will bring more predictable profits.[23,24]

Schumpeter is held to be the first to highlight a fundamental role of technical progress in affecting economic growth and social welfare in his book Capitalism, Socialism, and Democracy focuses on structural changes in firm, industry, or nation and their market to increase their R&D efforts for improving long-run economic performance.[25] He formulates two hypotheses that there is a positive relationship between innovative activity and firm size and between innovative activity and concentrated market structure. That is, large firms operating in a concentrated market will generate the technological progress that will bring economic development at the end. He argued that the process of creative destruction and innovation competition should replace price competition, which would justify monopolistic or oligopolistic competition.

There are also qualitative studies of that counterargument that the large firms are less favorable in terms of innovation.[26,27,28] As firms grow large, they may either lose managerial control of or become more bureaucratic toward scientists and technologists who perform R&D. Moreover, the incentives given to the scientist or entrepreneurs may not be explicit, as either their ability to capture the benefits of individual efforts weakens or their creativity is frustrated by the conservative hierarchies of large firms.

A number of empirical studies that examine a relationship between R&D and firm size are based on individual industries or across industries. These are done either by regression analysis in which R&D intensity is the dependent variable and firm size or other influential factors are independent variable or by a cross-sectional analysis restricted to R&D performers and spied in a logged form. They all fail to reject a null hypothesis that a proportionality between R&D and firm size would be correlated in most industries regardless of restricting industry effects.[29,30] However, the studies are subject to the controversy that most of the data used for the regression analysis, especially in the earlier firm-level studies, are non-random and that, with fewer exceptions to study presence or the effects of data selection bias, there would be stronger features other than size in the R&D.

Finally it is necessary to reconsider the Schumpeterian hypothesis with respect to the current condition that most large firms operate business units in diverse industries. Cohen and Klepper (1996) arranged some empirical studies regarding R&D, innovation, and firm size into four stylized facts, “(1) the likelihood of performing R&D rises with firm size; (2) R&D and firm size are closely and positively related within industries; (3) R&D rises proportionately with firm size in most industries; (4) the number of patents or innovations generated per dollar of R&D declines with firm size” and prove them through R&D cost spreading.[31]

The cost-spreading model is based on the idea that large firms have an advantage of size given that the fixed cost generated by R&D can be spread out over a larger amount of output than in smaller firms and, through this process, the return on R&D will increase along with the level of output. It also implies that the rate of technical progress in an industry depends not only on total R&D investment but also on its market structure, such as that the fewer and cooperative firms engaging in R&D activity reduces chance of duplication in R&D spending. Moreover, it is more feasible to see large firms at the level of the business unit rather than overall size of the firm, and the relationship between R&D size is weaker in the industries where innovations are more saleable or the prospects for rapid growth due to innovation are stronger. However, it also emphasizes a role of smaller firms that have peculiar R&D competence on the diversity of projects that enable them to coexist with large firms.

Korean renewable energy R&D is mainly firm-based. That is, the large and smaller firms account for 74.2% of the R&D of renewable energy from 2008-2012 as described earlier in Figure 1. Various studies explain how the large firms are favorable for R&D productivity, as per the cost-spreading model, that expects large firms who perform renewable energy R&D to show higher productivity than smaller ones. Thus, the hypothesis is set for this paper as below, Hypothesis: R&D productivity in large firms is higher than in other performers.


3. Methodology

There are two main approaches to analyze R&D productivity: production function and production frontier. Cobb–Douglas specification is one of the representative approaches in production function, which focuses on mathematical equations that relate quantities of inputs to quantities of maximum level of outputs. That is, its interest lies in estimating the coefficient of regression equations that explain an average propensity of correlation between inputs and outputs. On the other hand, production frontier is based on estimating a frontier to measure the distance between the frontier and each observed unit, called decision-making units (DMUs), and compare DMUs to know which one is the most efficient. DMUs on the frontier line are described as the best performer in the reference group and benchmarking units to the less efficient DMUs.

Scholars researching innovation and wealth creation generated by technological push simplify a process from R&D activity to invention, design and development, and innovation as a linear model.[32] Research and creativity will generate inventions, which are only ideas without economic value, and then some economically feasible invention will be innovated after going through the design and development process. Therefore, firms investing in R&D activity are aiming at gaining economic profits from the innovation by leading the early market in new products’ commercialization. A number of input factors are employed throughout the innovation process in various forms, such as scientific and technological knowledge as intangible resources and human resources, and time and salary as tangible resources, to result in desired outputs like research papers, patents, engineering fees, and economic outcomes through commercial use. Outputs can be divided into direct and indirect outputs; the former are created directly from the R&D activity and latter refer to the economic outcome that is the ultimate purpose for R&D activity.

3.1 Data Envelopment Analysis (DEA)

DEA is developed as one of nonparametric production frontier methodologies to analyze efficiency for like public projects or non-profit firms that the price information on input or/and output is normally not given or units of measure to be estimated are different or difficult to synthesize as one index. In addition, it allows to handle multiple inputs and multiple outputs generated sporadically through out the process, namely the methodology is useful for estimating R&D productivity since it owns intrinsically various inputs and output. It assumes that a condition of Pareto-Koopman efficiency that a unit’s efficiency cannot be increased unless other’s efficiency decreases.[33]

Farrell (1957) firstly introduced the efficiency analysis using multiple inputs and multiple outputs to measure a firm and it was developed by Charnes, Cooper and Rhodes (1978) who proposed DEA for the first time, which is input-oriented DEA model on a constant return to scale (CRS); CCR model, and by Banker, Charnes and Cooper (1984) who distinguishes technical efficiency (TE) and scale efficiency (SE) since the firms’ R&D activity is not possible to operate at optimal scale in practical; BCC model.[34,35,36]

According to Golany et al. (1989), DMUs used for DEA analysis should satisfy some homogeneity conditions in order to have the result with economic significance.[37] The conditions are the projects are performed under similar purpose, the DMUs are existing in the homogeneity market, and all input and output data are in every DMUs and the data are different each other. In addition, the proper number of DMUs should be existed since it is less plausible that majority of DMUs would be efficient if the number of DMUs are less than the number of input and output variables. There is not a unified standard as to the number of DMU but most of papers use the standard suggested by Fitzsimmons et al. (1994) described as below

K2N+M(1) 

K stands for number of DMU and N and M are the number of variables of input and output data.[38]

When n decision-making units (DMUs) are to be evaluated, each DMUj(j = 1, ..., n) consumes m inputs (i = 1, 2 ..., m) in order to produce s outputs (r = 1, 2 ..., s). Clearly, DMUj(j = 1, ..., n) uses amounts Xj = xij inputs (i = 1, 2 ..., m and xij > 0) and produces amounts Yj = yrj of outputs (r = 1, 2 ..., s and yrj > 0). In addition, there are two properties to ensure a piecewise linear approximation to the efficient frontier and the area dominated y the frontier; convexity and inefficiency. That is,j=1nλjxiji=1,2,,m and j=1nλjyrjr=1,2,,s are possible inputs and outputs attainable by the DMUj where λj(j = 1, ... n) are positive scalars and the same outputs can be produced by using more inputs; the same inputs can be used to produce less outputs.

The CRS assumption is suitable when all firms are operating at an optimal scale, but it is not possible in practical due to external factors like imperfect market condition, government regulation, etc.. Therefore, BCC model based on variable returns to scale (VRS) conditions, which can divide TE and SE simply by adding the convexity constraint; λj=1. The input-oriented model estimates the inputs in each DMU that can be minimized while the outputs are maintained; on the contrary the output-oriented model finds the outputs in each DMU that can be maximized at the current inputs.

Either input or output oriented DEA model is optionally selectable to use for the analysis for R&D productivity according to its research purpose. Input oriented model is suitable to the case in order to estimate minimum input variables at the current output maintained, that is the model is capable to acquire minimum R&D investment or/and human resources retaining current output level like number of patent, paper, or volume of sales. In this paper, the efficiency is estimated based on output-oriented BCC model due to the researches and public opinion that the R&D performance is not sufficient to the current level of R&D investment on the increase and the qualitative improvement in R&D productivity is necessary bringing up maximum outputs under the present R&D support.

The efficiency score of output-oriented DEA based on VRS condition (output-oriented BCC model), φ*, is calculated as below

*=max(2) 

subject to

j=1nλjxijxioi=1,2,,m;(3) 
j=1nλjyrjyror=1,2,,s;(4) 
j=1nλj=1(5) 
λj0i=1,2,,n(6) 

If ∅*≠ 1 input and outputs slacks can be expressed as

si-=xio-j=1nλjxiji=1,2,…,m;(7) 
si+=j=1nλjyro-*yror=1,2,…,s.(8) 

DMUo is less efficient not only if *≠ 1 but also if * = 1 and si- and/or sr+ are non-zero for all i. Then, the input and output slacks are estimated, which make * optimize, are also estimated

maxi=0msi-+r=0ssi-(9) 

subject to

j=1nλixij+si-=xio(10) 
j=1nλixij-sr+=*yrci=1,2,,n(11) 
j=1nλj=1j=1,2,,n(12) 
λj0(13) 

Finally the two-state output-oriented BCC model can be evaluated as

max+εi=1msi-+r=1ssr+(14) 

subject to

j=1nλixij+si-=xioi=1,2,,m;(15) 
j=1nλixrj-sr+=*yror=1,2,,s;(16) 
j=1nλi=1(17) 
λj0j=1,2,,n(18) 

Next, the VRS model is able to separate TE and SE, which may be calculated as the ratio of TE on the assumption of CRS to TE on the assumption of VRS. The technical efficiencies on the basis of VRS, θ* for the input-oriented model and * for the output-oriented model, are given already by calculations above and the TE under the CRS can be estimated without the convexity constraint; λj=1. Therefore, TE under input-oriented based on CRS assumption is estimated as

θ*=minθ(19) 

subject to

j=1nλjxijθxioi=1,2,,m;(20) 
j=1nλjyrjyror=1,2,,s;(21) 
λj0(22) 

and TE under output-oriented based on CRS assumption

is described as

*=max(23) 

subject to

j=1nλixijxioi=1,2,,m(24) 
j=1nλiyrjyror=1,2,,s;(25) 
λj0(26) 

Finally, SE(Xj, Yj ) and TE (Xj, Yj) for each DMU is

SEXj,Yj=θj*CCRθj*BCCj=1,,n(27) 

for input-oriented BCC model,

TEXj,Yj=1-SEXj,Yjj=1,,n.(28) 

for output-oriented BCC model,

TEXj,Yj=1-SEXj,Yjj=1,,n.(29) 

and for TE.


4. Analytical framework

This paper uses the output-oriented BCC model to estimate an econometric efficiency of R&D productivity in 1340 national R&D projects of Korea renewable energy technology who received public R&D in order to test the hypothesis “R&D productivity in large firms is higher than that in other performers,” where performers include large firms and smaller firms as well as universities and government-supported research institutes (institutes, in short).

An assumption of technological push that will enhance economical growth and social welfare is utilized for the analysis. In addition, in order to satisfy the homogeneity condition that the DMU should be operated under a similar purpose, the projects are distinguished by the technical progress phase (basic, applied, and development). Basic research is performed to obtain new knowledge, applied research to acquire knowledge for the practical application of science, and development research to have practical products with economical value to sell in the market.

Furthermore, two input and five output variables whose data in every DMU are accessible through the National Technical Information Service (NTIS) system are chosen to analyze. The input and output data from the 1340 projects called DMUs are yearly-based data, and the DMUs that did not received R&D support are not counted. In other words, data of the R&D project whose research period is at least more than two or three years are divided by year from 2008 to 2012. The input variables considered are pubic R&D financial support as well as firms’ private R&D investment and number of workers, regardless of their academic background. As output variables, five direct outputs without economic value—number of Scientific citation index (SCI) and non-SCI paper publications, number of applied and registered patents, and others without economical value such as report, prototype, etc.—and two economic outputs—number of receiving engineering fee and number of commercialization— are considered. The time lag from inputs to outputs is naturally not needed to consider for this analysis, since the output data is discovered in practice if occurred in the NTIS system and the efficiency of DMUs that have fewer or no outputs is to appear less efficient compared to other DMUs.

Paper publication is an objective indicator for basic research, and SCI papers are regarded to have higher quality than non-SCI papers. However, due to the lower number of publications that would not be representative as output variable and the language barrier that SCI paper are generally written in English, non-SCI papers are also counted as one of the output variables. Likewise, the registered patent, which is obtainable when the invention is considered to have new technological characteristics, is superior in quality but smaller in number than the applied patent; nevertheless, the applied patent is brought to supplement the quantitative profile. As an economic output, engineering fee in the private sector is generated when one party uses the right in asset or intellectual property owned by others. On the other hand, the engineering fee that is supported by public R&D is obtained when the relevant R&D is successfully commercialized, and some part of benefit is returned to the government. In addition, when the product is sold in the market, the product can be considered commercialized.

Thus, the projects are classified into basic, applied, and development as a first step and estimated by output-oriented BCC model of DEA and slack analysis by performer as follows. The data are collected from the NTIS and the period of interest is from 2008 to 2012, when R&D investment was geometrically increased and the project that is expected to commercialize was realized in the Korean renewable energy technology. The NTIS data shows the direct inputs on each R&D project as an amount of investment and human resources in number as well as direct performances as SCI paper, non-SCI paper, registered patent, applied papers, engineering fee and commercialization by year. That is, the time lag from R&D investment to commercialization stage is automatically considered.


Fig. 3. 
Analytical framework to analyze R&D efficiency in Korea renewable energy


5. Empirical research
5.1 Data

The descriptive statistic of data from 2008 to 2012 is shown in Table 1 as below. During the period, 1340 projects were performed for renewable energy technologies under the supervision of Korea Energy Technology Evaluation and Planning (KETEP): 280 for large firms, 380 for medium-sized firms, 343 for institutes, 316 for universities, and 21 for others.

Table 1. 
Descriptive statistics of renewable energy R&D in Korea in 2008-2012



Data are classified according to technical progress phase and performers. In basic research, a large amount of R&D investment and workers are dedicated to universities and institutes, accounted for 71.3% of total R&D investment and 76.5% in total number of workers. On the other hand, average R&D investment and number of R&D workers are the higher in the large firms, which performed only 10 basic research programs, compared to the universities and institutes, which conducted 82 and 60, respectively, during the same period. R&D investment and workers in smaller firms are the least among the performers, but the average is higher than those for universities and institutes, though lower than that for large firms. In terms of the outputs, the direct outputs are more produced in universities and institutes both in total and average, but less in economical outputs presented as engineering fee and commercialization The outputs as applied research accomplished in number gives weight to institutes.

In applied research, a share of R&D investment and workers in the institutes are the most between performers but the large firms are still the largest beneficiary per project. Similarly for basic research, the institutes beside the inputs, and the economical outputs are lower than the firms’. It is notable that the smaller firms produce more economic outputs than large firms compared with the inputs, the least in total amount among performers.

The researches on development phase has the largest share of R&D investment and workers in total compared to other research phases since they are believed to generate economical returns on the R&D spend. The large firms account for the largest proportion of R&D investment and workers, with 67.6% and 65.7%, respectively, and are assumed to perform larger projects relative to those of other performers. Smaller firms have the next highest proportions for both figures. The absolute total figures in outputs are superior to those of other research in different technical phases, but it is noticeable that the averages are not distinctly different among performers.

5.2 Result

The result gained using the output-oriented VRS model is described in Table 2 as below. First of all, efficiency of the 1,227 DMUs out of the 1340 DMUs including the researches that did not belong to any other technical progress phase is estimated by basic, applied, and development and then classified by performer as large and smaller firms, institutes, and universities. Thus, the results of efficiency and slack analysis shown in Table 2 are the average figures for each group by technical progress phase and by performer.

Table 2. 
Econometric efficiency of R&D productivity of Korea national R&D projects in renewable energy technology



The overall average efficiency was 0.72 for basic, 0.60 for applied, and 0.50 for development research, which indicates the lowest efficiency score. Distinguishing the efficiencies by performer, universities’ efficiency in basic research shows the highest 0.78 more than average, and the efficiencies in other performers are nearly similar, though the large firms’ are slightly lower. In DMUs in applied research, the efficiency in smaller firms is exceptionally higher than other performers’, with 0.75, followed by large firms with 0.69; thus, the average efficiency scores of applied research in the firms exceed total average efficiency score of 0.60. The level of efficiencies in development research is almost alike among performers and it is also conspicuous that they are somewhat lower than those of other technical progress phases.

According to the result allowing to show the amount of input and output slacks that would be increased or decreased for improving efficiency, the estimated numerical values vary considerably among performers and technical progress phases. Regardless of performer, the results of efficient target that maximizes efficiency by manipulating inputs in R&D investment and labor to have maximum output level show that the current level of inputs are not required to achieve the current level of outputs. That is, outputs could be increased without increasing the current amount of inputs.

Moreover, DEA can provide information to show the DMUs whose efficiency score is 1. The DMUs in basic research phases are the most efficient, while almost two thirds of DMUs in development phase, whose project accounts for nearly 70% of R&D in number, are inefficient. In other words, the projects in the development phases show the lowest efficiency in terms of number with score ‘1’ compared to basic and applied researches. Looking at the results more in detail by performer, the combined smaller and large firms seem to perform more efficient R&D projects on average, with relatively more efficient value in applied research than universities and institutes. The number of DMUs with efficiency with score ‘1’ in development research in the firms is slightly higher than in the universities and institutes. In addition, the efficiencies between small and large firms are also not notably different, and the efficiency in smaller firm is rather higher than large firms, at 35.5% and 32.5%, respectively.

It is necessary to consider for this study if there are efficiency of scale between DMUs since the efficiency can be increased or decreased as scale increases. The scale of R&D investment and labor as input variables, as well as their outputs produced in various forms, vary by performer and technical progress phase. As a result, regardless of characteristics divided by performer and technical progress phase, there is more in efficiency of scale than technical efficiency, meaning the efficiency is increased as of the size of the DMU is increased.


6. Conclusion

This study uses the output-oriented BCC model of the DEA to estimate econometric efficiency of R&D productivity among 1340 national R&D projects in renewable energy technology in Korea by performer and by technical progress phase. The DMUs are classified by level of technical progress phase ((basic, applied, and development) as a first step to satisfy the homogeneity condition and the result of efficiencies are averaged by performer to verify the hypothesis.

The result explains that one of the reasons why the industry development in renewable energy in Korea is not growing fast is that firms’ R&D productivity in the renewable energy technology is low. In fact, the large firms are proved to have several benefits in performing R&Ds compared to smaller firms, in spite of some weakness such as inflexible bureaucratic R&D management, and expect to have more fruitful results in outputs than another performers. Therefore, they invest a large amount of their funds, including public financial support from government, as well as and human resources into the renewable technology, especially on development phase, for which they anticipate economic outcome in the short term.

However, while the efficiencies on basic and applied research are rather high in most performers, since direct outputs from R&D support are sufficiently created, most research on the development phase correlated to profitability performed mostly by firms are rather inefficient. This is because its economical outputs compared to initial R&D support are inadequately produced, though those performers are expecting R&D results with economic value. In addition, the efficiencies on the development phases show the efficiency in the smaller firms is slightly higher than large firms, who received the R&D support the most in amount as well as per project; thus, the hypothesis is rejected.

The resulted efficiencies are shown to derive more from efficiency of scale than technical efficiency, meaning the R&D efficiency increases as quantities of R&D inputs increase, which should be considered in tackling how to improve R&D in a qualitative aspect. According to the research by Cohen and Klepper (1996) described earlier, the cost-spreading model is valid in the large business unit where the firm operates as one of diverse business rather than the whole size of the firm. Thus, it is needed to review whether the R&D investment and number of workers data should be made only according to the firm size rather than with consideration that the firm’s business unit per se has an ability to make a result of the R&D culminate in real commercialization. Therefore, both ex-ante and ex-post analysis to understand firms’ ability to complete R&D activity and to assess the R&D activity terminated are required to further enhance R&D productivity.

In addition, securing industrial competitiveness in the overseas renewable energy market is necessary through more efforts into R&D focused on the core technology. For the purpose of expanding the market share, smaller firms that possess unique R&D on the diversity of projects are able to play an important role, which also enables them to coexist with large firms. There is a mutual agreement of systemic cooperation between large firms that focus on systemic R&D process and smaller firms that improve components, equipment, or/and materials in Korean industry. Therefore, it is desirable to encourage more knowledge and technology sharing between smaller and large firms for mutual growth by localizing the renewable energy technology and further broadening markets overseas.

The limitation of this paper is that it focuses on quantity-based output data for the analysis. For instance, some DMUs that produce a smaller number of papers or patent might produce papers or patents that are superior in quality. By the same logic, economical benefits counted in number of commercialization and engineering fee would increase for such DMUs.


Note
1) Here, the criteria classifying larger and smaller is based on “smaller enterprises basic law.” The term “large firms” applies to several conditions: that number of full-time labor is more than 1,000, the equity capital is over KRW 100 billion, or average sales are more than KRW 150 until 2014. The law was revised in 2015 with new revised applications, for instance the firms whose 3-year average sales is suited to the criteria by type of industry, total amount of assets is less than KRW 500 billion, and who do not belong to the firm group of limited mutual investment are defined as smaller firms.

References
1. KETEP, 2014, Dec, 31, New and renewable energy, Retrieved 4 20, 2015, from Korea institute of Energy Technology Evaluation and Planning: http://www.ketep.re.kr/home/information/information08_4.jsp?flag=4.
2. OECD/IEA, (2014), IEA Energy Technology RD&D Statistics, Retrieved 04 22, 2015, from OECD iLibraryhttp://www.oecd-ilibrary.org.
3 4 5. NTIS, 2014, Dec, 31, National R&D programs management. (I. &. Ministry of Science, Producer), Retrieved 2 20, 2015, from Investigation and analysis statistic service:http://rndgate.ntis.go.kr/matrix.do?method=mtMain&pageNum=1&subNum=1.
6. Chae, D., 2014, Jan, 8, Reduced again government budget on new and renewable energy, Retrieved 5 1, 2015, from Energy & Environment News: http://www.e2news.com/news/articleView.html?idxno=73976.
7. Galbraith, J., (1952), American Capitalism: The concept of countervailing power, Boston, Houghton Mifflin.
8. Scherer, F. M., (1997), Ross, 1990, Industrial Market Structure and Economic Performance, A., Boston.
9. MOTIE, (2012), Plan for securing medium-sized firms market in new and renewable energy, Ministry of Trade, Industry and Energy, Sejong, MOTIE.
10. MOTIE, (2013), Plan for securing medium-sized firms market in new and renewable energy –PV industry, Ministry of Trade, Industry and Energy, Sejong, MOTIE.
11. Park, H., 2013, Feb, 26, Wind Energy, Retrieved 4 21, 2015, from ETnews: http://www.etnews.com/201302260309.
12. the Small and Medium Business Administration, 2009, Sep, 18, Prospect green technology selection and intensive foster according to choice and concentration, Retrieved 4 21, 2015, from press release : http://smba.go.kr/webdata/board/CHUNGBUK_NEWS_20/CHUNGBUK_NEWS_20_21373_1.hwp.files/Sections1.html.
13. Kang, J., & Oh, Y., 2013, Feb, 20, Prospect the export in Korea renewable energy in decline for 3 years, Retrieved 4 24, 2015, from Yonhapnews: http://www.yonhapnews.co.kr/economy/2013/02/18/0301000000AKR20130218192100008.HTML.
14. Korea energy management corporation, 2014, Dec, 31, Industrial statistics, Retrieved 4 24, 2015, from Knowledge portal, New and renewable energy Korea :https://www.renewableenergy.or.kr/spc/stats/indust/selectIndust.do.
15. Min, Y., & Kang, S., (2014), energy technology R&D investment analysis of OECD countries and Korea, International commerce and information review, 16(4), p363-384.
16. Jin, S., & Im, Im., (2007), Research on oversea dependency of industry and technology in renewable energy, Korean Association for Policy Science, 11(4), p159-177.
17. Kim, S., Jo, K., Lee, S., & Im, B., (2011), An Analysis on the Economic Performance of Industrial R&D Investments to Achieve Green Growth Strategy, Korea economy research, 29(2), p5-50.
18. Choi, G., Kim, M., Cho, I., Kim, E., & Heo, E., (2014), Efficiency analysis on national energy technology development program by using DEA, Innovation studies, 9(2), p77-98.
19. Kim, H., Lee, D., Kim, K., & Park, S., (2014), Measuring efficiency of investment in the deployment and technology development of renewable energy in Korea using the DEA, Journal of the Korean Institutes of Industrial Engineers, 40(4), p358-365.
20. Oh, S., & Lee, C., (2014), Economical performance analysis on national renewable energy R&D programs, Korean Energy Economics Review, 13(2), p174-197.
21 25. Griliches, Z., (1957), Hybrid corn: An exploration in the economics of technological change, Econometrical, Journal of the Econometric Society, p501-522.
22. Schumpeter, J. A., (1942), Socialism, capitalism and democracy, Harper and Brothers..
23. Solow, Robert M., “Technical change and the aggregate production function.”, The review of Economics and Statistics, (1957), p312-320.
24. Rosenberg, N., (1969), The direction of technological change: inducement mechanisms and focusing devices, Economic Development and Cultural Change, p1-24.
26. Scherer, F. M., (1965), Firm size, market structure, opportunity, and the output of patented inventions, The American Economic Review, p1097-1125.
27. Nelson, R. R., Peck, M. J., & Kalachek, E. D., (1967), Technology, economic growth, and public policy; a Rand Corporation and Brookings Institution study.
28. Pavitt, K., Robson, M., & Townsend, J., (1987), The size distribution of innovating firms in the UK: 1945-1983, The Journal of Industrial Economics, p297-316.
29. Horowitz, I., (1962), Firm size and research activity, Southern Economic Journal, p298-301.
30. Hamberg, D., (1964), Size of firm, oligopoly, and research: The evidence, Canadian Journal of Economics and Political Science/Revue canadienne de economiques et science politique, 30(01), p62-75.
31. Cohen, W. M., & Klepper, S., (1996), A reprise of size and R & D, The Economic Journal, p925-951.
32. Swann, G. P., (2009), The economics of innovation: an introduction, Edward Elgar Publishing.
33. Koopmans, T. C., (1951), Analysis of production as an efficient combination of activities, Activity analysis of production and allocation, 13, p33-37.
34. Farrell, M. J., (1957), The measurement of productive efficiency, Journal of the Royal Statistical Society, Series A (General), p253-290.
35. Charnes, A., Cooper, W. W., & Rhodes, E., (1978), Measuring the efficiency of decision making units, European journal of operational research, 2(6), p429-444.
36. Banker, R. D., Charnes, A., & Cooper, W. W., (1984), Some models for estimating technical and scale inefficiencies in data envelopment analysis, Management science, 30(9), p1078-1092.
37. Golany, B., & Roll, Y., (1989), An application procedure for DEA, Omega, 17(3), p237-250.
38. Fitzsimmons, J. A., & Fitzsimmons, M. J., (1994), Service management for competitive advantage, New York, NY, McGraw-Hill.