Third term, 1954–1957
Once the National Government had been assured of a third consecutive term, Holland gave up the finance portfolio to Jack Watts, the former Minister of Industries and Commerce. With the loss of one National MP (W.F. Fortune) and the retirement of several older ministers, Holland rejuvenated his Cabinet with several younger men including Dean Eyre, Sid Smith, John McAlpine, Tom Shand, Geoff Gerard, and Eric Halstead. In 1955 the annual terminal income tax assessment system was phased out in favour of a Pay As You Earn (PAYE) system. Also, the Tourist Hotel Corporation was established with Holland's strong support and against the opposition of Holyoake (by this time Deputy Prime Minister), who feared that tourism would divert investment away from agriculture. After Dean Eyre went on a private overseas business trip in 1956, Holland introduced a code of ethics that banned any conflict of interest between a minister's public duty and private affairs.
During Holland's last years in office, New Zealand also faced a serious balance of payments crisis that had been precipitated by a rapid decline in overseas demand for the country's butter, wool, and cheese exports. In addition, Holland's health was proving less and less able to withstand the strain of his duties, and his memory began to fail him. Amid the Suez Crisis in October 1956, Holland suffered a mild heart attack or stroke (accounts vary) while working in his office. However, far from retreating to bed, he insisted on remaining at the office for the next 48 hours until the crisis was resolved. According to his biographer Gustafson, Holland's physique never fully recovered from that incident. During the Suez Crisis, New Zealand and Australia were among the few countries to defend the Anglo-French invasion of the Suez Canal.
Despite his conspicuous medical problems, Holland was initially reluctant to hand over the Party's leadership to his deputy, Holyoake. But following a meeting the following year with several senior National Party officials including Holyoake himself, John Marshall, Jack Watts, and the Party's President Alex McKenzie, Holland reluctantly agreed to resign as Prime Minister and Leader of the Party.
On 12 August 1957, Holland announced his retirement at the National Party's annual conference in Wellington. Once he had made that announcement, he became so obviously sick that he had to be helped back to his hotel, where a doctor was called. The following day, Holyoake was formally named Holland's successor. Holland handed over the Prime Ministry to Holyoake on 20 September. Shortly afterwards, on 23 September, he was appointed a Knight Grand Cross of the Order of the Bath. He remained in Cabinet, as minister without portfolio; but he left the legislature for good at the 1957 general election, in which Holyoake went down to defeat, and which saw the advent of a second Labour Government under Walter Nash.