SplitEditor - Edit machine code and LiveIntervals for live range splitting. More...

#include "CodeGen/SplitKit.h"

Public Types
enum	ComplementSpillMode { SM_Partition, SM_Size, SM_Speed }
	ComplementSpillMode - Select how the complement live range should be created. More...

Public Member Functions
	SplitEditor (SplitAnalysis &sa, AliasAnalysis &aa, LiveIntervals &lis, VirtRegMap &vrm, MachineDominatorTree &mdt, MachineBlockFrequencyInfo &mbfi)
	Create a new SplitEditor for editing the LiveInterval analyzed by SA. More...

void	reset (LiveRangeEdit &, ComplementSpillMode=SM_Partition)
	reset - Prepare for a new split. More...

unsigned	openIntv ()
	Create a new virtual register and live interval. More...

unsigned	currentIntv () const
	currentIntv - Return the current interval index. More...

void	selectIntv (unsigned Idx)
	selectIntv - Select a previously opened interval index. More...

SlotIndex	enterIntvBefore (SlotIndex Idx)
	enterIntvBefore - Enter the open interval before the instruction at Idx. More...

SlotIndex	enterIntvAfter (SlotIndex Idx)
	enterIntvAfter - Enter the open interval after the instruction at Idx. More...

SlotIndex	enterIntvAtEnd (MachineBasicBlock &MBB)
	enterIntvAtEnd - Enter the open interval at the end of MBB. More...

void	useIntv (const MachineBasicBlock &MBB)
	useIntv - indicate that all instructions in MBB should use OpenLI. More...

void	useIntv (SlotIndex Start, SlotIndex End)
	useIntv - indicate that all instructions in range should use OpenLI. More...

SlotIndex	leaveIntvAfter (SlotIndex Idx)
	leaveIntvAfter - Leave the open interval after the instruction at Idx. More...

SlotIndex	leaveIntvBefore (SlotIndex Idx)
	leaveIntvBefore - Leave the open interval before the instruction at Idx. More...

SlotIndex	leaveIntvAtTop (MachineBasicBlock &MBB)
	leaveIntvAtTop - Leave the interval at the top of MBB. More...

void	overlapIntv (SlotIndex Start, SlotIndex End)
	overlapIntv - Indicate that all instructions in range should use the open interval, but also let the complement interval be live. More...

void	finish (SmallVectorImpl< unsigned > *LRMap=nullptr)
	finish - after all the new live ranges have been created, compute the remaining live range, and rewrite instructions to use the new registers. More...

void	dump () const
	dump - print the current interval mapping to dbgs(). More...

void	splitSingleBlock (const SplitAnalysis::BlockInfo &BI)
	splitSingleBlock - Split CurLI into a separate live interval around the uses in a single block. More...

void	splitLiveThroughBlock (unsigned MBBNum, unsigned IntvIn, SlotIndex LeaveBefore, unsigned IntvOut, SlotIndex EnterAfter)
	splitLiveThroughBlock - Split CurLI in the given block such that it enters the block in IntvIn and leaves it in IntvOut. More...

void	splitRegInBlock (const SplitAnalysis::BlockInfo &BI, unsigned IntvIn, SlotIndex LeaveBefore)
	splitRegInBlock - Split CurLI in the given block such that it enters the block in IntvIn and leaves it on the stack (or not at all). More...

void	splitRegOutBlock (const SplitAnalysis::BlockInfo &BI, unsigned IntvOut, SlotIndex EnterAfter)
	splitRegOutBlock - Split CurLI in the given block such that it enters the block on the stack (or isn't live-in at all) and leaves it in IntvOut. More...

Detailed Description

SplitEditor - Edit machine code and LiveIntervals for live range splitting.

Create a SplitEditor from a SplitAnalysis.
Start a new live interval with openIntv.
Mark the places where the new interval is entered using enterIntv*
Mark the ranges where the new interval is used with useIntv*
Mark the places where the interval is exited with exitIntv*.
Finish the current interval with closeIntv and repeat from 2.
Rewrite instructions with finish().

Definition at line 258 of file SplitKit.h.

Member Enumeration Documentation

◆ ComplementSpillMode

enum llvm::SplitEditor::ComplementSpillMode

ComplementSpillMode - Select how the complement live range should be created.

SplitEditor automatically creates interval 0 to contain anything that isn't added to another interval. This complement interval can get quite complicated, and it can sometimes be an advantage to allow it to overlap the other intervals. If it is going to spill anyway, no registers are wasted by keeping a value in two places at the same time.

Enumerator

SM_Partition

SM_Partition(Default) - Try to create the complement interval so it doesn't overlap any other intervals, and the original interval is partitioned.

This may require a large number of back copies and extra PHI-defs. Only segments marked with overlapIntv will be overlapping.

SM_Size

SM_Size - Overlap intervals to minimize the number of inserted COPY instructions.

Copies to the complement interval are hoisted to their common dominator, so only one COPY is required per value in the complement interval. This also means that no extra PHI-defs need to be inserted in the complement interval.

SM_Speed

SM_Speed - Overlap intervals to minimize the expected execution frequency of the inserted copies.

This is very similar to SM_Size, but the complement interval may get some extra PHI-defs.

Definition at line 276 of file SplitKit.h.

Constructor & Destructor Documentation

◆ SplitEditor()

SplitEditor::SplitEditor	(	SplitAnalysis &	sa,
		AliasAnalysis &	aa,
		LiveIntervals &	lis,
		VirtRegMap &	vrm,
		MachineDominatorTree &	mdt,
		MachineBlockFrequencyInfo &	mbfi
	)

Create a new SplitEditor for editing the LiveInterval analyzed by SA.

Newly created intervals will be appended to newIntervals.

Definition at line 366 of file SplitKit.cpp.

Member Function Documentation

◆ currentIntv()

unsigned llvm::SplitEditor::currentIntv ( ) const

inline

currentIntv - Return the current interval index.

Definition at line 459 of file SplitKit.h.

◆ dump()

LLVM_DUMP_METHOD void SplitEditor::dump ( ) const

dump - print the current interval mapping to dbgs().

Definition at line 396 of file SplitKit.cpp.

References llvm::MachineInstrBuilder::addReg(), llvm::LaneBitmask::all(), llvm::LaneBitmask::any(), assert(), llvm::IntervalMap< KeyT, ValT, N, Traits >::begin(), llvm::BuildMI(), llvm::MachineInstr::bundleWithPred(), llvm::LiveRangeEdit::canRematerializeAt(), llvm::IntervalMap< SlotIndex, unsigned >::const_iterator, llvm::LiveRange::createDeadDef(), llvm::dbgs(), llvm::tgtok::Def, llvm::VNInfo::def, llvm::RegState::Define, DefMI, llvm::MachineInstr::defs(), E, llvm::IntervalMap< KeyT, ValT, N, Traits >::empty(), llvm::MCInstrInfo::get(), llvm::LiveRangeEdit::get(), llvm::LaneBitmask::getAll(), llvm::LiveIntervals::getInstructionFromIndex(), llvm::getInternalReadRegState(), llvm::LiveIntervals::getInterval(), llvm::MachineRegisterInfo::getMaxLaneMaskForVReg(), llvm::LaneBitmask::getNone(), llvm::LaneBitmask::getNumLanes(), llvm::MCRegisterInfo::getNumSubRegIndices(), llvm::VirtRegMap::getOriginal(), llvm::LiveRangeEdit::getParent(), llvm::PointerIntPair< PointerTy, IntBits, IntType, PtrTraits, Info >::getPointer(), llvm::LiveRangeEdit::getReg(), llvm::MachineRegisterInfo::getRegClass(), llvm::SlotIndex::getRegSlot(), llvm::LiveIntervals::getSlotIndexes(), llvm::TargetRegisterInfo::getSubClassWithSubReg(), llvm::TargetRegisterInfo::getSubRegIndexLaneMask(), llvm::getUndefRegState(), llvm::LiveIntervals::getVNInfoAllocator(), llvm::LiveRange::getVNInfoAt(), llvm::LiveInterval::hasSubRanges(), I, llvm::VNInfo::id, llvm::DenseMapBase< DerivedT, KeyT, ValueT, KeyInfoT, BucketT >::insert(), llvm::SlotIndexes::insertMachineInstrInMaps(), llvm::SlotIndex::isValid(), llvm_unreachable, llvm::LiveRangeEdit::Remat::OrigMI, llvm::SmallVectorTemplateBase< T, bool >::push_back(), llvm::LiveInterval::refineSubRanges(), llvm::LiveInterval::reg, Reg, llvm::LiveRangeEdit::rematerializeAt(), llvm::report_fatal_error(), llvm::NVPTX::PTXCvtMode::RM, llvm::PointerIntPair< PointerTy, IntBits, IntType, PtrTraits, Info >::setInt(), and llvm::LiveInterval::subranges().

◆ enterIntvAfter()

SlotIndex SplitEditor::enterIntvAfter ( SlotIndex Idx )

enterIntvAfter - Enter the open interval after the instruction at Idx.

Return the beginning of the new live range.

Definition at line 709 of file SplitKit.cpp.

References assert(), llvm::dbgs(), llvm::VNInfo::def, llvm::SlotIndex::getBoundaryIndex(), llvm::LiveIntervals::getInstructionFromIndex(), llvm::LiveRangeEdit::getParent(), llvm::MachineInstr::getParent(), llvm::LiveRange::getVNInfoAt(), llvm::VNInfo::id, LLVM_DEBUG, and MI.

◆ enterIntvAtEnd()

SlotIndex SplitEditor::enterIntvAtEnd ( MachineBasicBlock & MBB )

enterIntvAtEnd - Enter the open interval at the end of MBB.

Use the open interval from the inserted copy to the MBB end. Return the beginning of the new live range.

Definition at line 727 of file SplitKit.cpp.

References assert().

◆ enterIntvBefore()

SlotIndex SplitEditor::enterIntvBefore ( SlotIndex Idx )

enterIntvBefore - Enter the open interval before the instruction at Idx.

If the parent interval is not live before Idx, a COPY is not inserted. Return the beginning of the new live range.

Definition at line 692 of file SplitKit.cpp.

References assert(), llvm::dbgs(), llvm::VNInfo::def, llvm::SlotIndex::getBaseIndex(), llvm::LiveIntervals::getInstructionFromIndex(), llvm::LiveRangeEdit::getParent(), llvm::MachineInstr::getParent(), llvm::LiveRange::getVNInfoAt(), llvm::VNInfo::id, LLVM_DEBUG, and MI.

Referenced by splitSingleBlock().

◆ finish()

void SplitEditor::finish ( SmallVectorImpl< unsigned > * LRMap = nullptr )

finish - after all the new live ranges have been created, compute the remaining live range, and rewrite instructions to use the new registers.

Parameters

LRMap When not null, this vector will map each live range in Edit back to the indices returned by openIntv. There may be extra indices created by dead code elimination.

Definition at line 1470 of file SplitKit.cpp.

References assert(), llvm::SmallVectorImpl< T >::clear(), llvm::VNInfo::def, llvm::VNInfo::isUnused(), llvm::SmallVectorTemplateBase< T, bool >::push_back(), Reg, llvm::LiveInterval::removeEmptySubRanges(), llvm::LiveRange::RenumberValues(), llvm::SmallVectorImpl< T >::resize(), llvm::SmallVectorBase::size(), SM_Partition, SM_Size, and SM_Speed.

◆ leaveIntvAfter()

SlotIndex SplitEditor::leaveIntvAfter ( SlotIndex Idx )

leaveIntvAfter - Leave the open interval after the instruction at Idx.

Return the end of the live range.

Definition at line 758 of file SplitKit.cpp.

References assert(), llvm::dbgs(), llvm::VNInfo::def, llvm::SlotIndex::getBoundaryIndex(), llvm::LiveIntervals::getInstructionFromIndex(), llvm::SlotIndex::getNextSlot(), llvm::LiveRangeEdit::getParent(), llvm::MachineInstr::getParent(), llvm::LiveRangeEdit::getReg(), llvm::LiveRange::getVNInfoAt(), llvm::VNInfo::id, llvm::SlotIndex::isSameInstr(), LLVM_DEBUG, MI, and llvm::MachineInstr::readsVirtualRegister().

Referenced by splitSingleBlock().

◆ leaveIntvAtTop()

SlotIndex SplitEditor::leaveIntvAtTop ( MachineBasicBlock & MBB )

leaveIntvAtTop - Leave the interval at the top of MBB.

Add liveness from the MBB top to the copy. Return the end of the live range.

Definition at line 808 of file SplitKit.cpp.

References assert().

◆ leaveIntvBefore()

SlotIndex SplitEditor::leaveIntvBefore ( SlotIndex Idx )

leaveIntvBefore - Leave the open interval before the instruction at Idx.

Return the end of the live range.

Definition at line 789 of file SplitKit.cpp.

References assert(), llvm::dbgs(), llvm::VNInfo::def, llvm::SlotIndex::getBaseIndex(), llvm::LiveIntervals::getInstructionFromIndex(), llvm::SlotIndex::getNextSlot(), llvm::LiveRangeEdit::getParent(), llvm::MachineInstr::getParent(), llvm::LiveRange::getVNInfoAt(), llvm::VNInfo::id, LLVM_DEBUG, and MI.

Referenced by splitSingleBlock().

◆ openIntv()

unsigned SplitEditor::openIntv ( )

Create a new virtual register and live interval.

Return the interval index, starting from 1. Interval index 0 is the implicit complement interval.

Definition at line 674 of file SplitKit.cpp.

References llvm::LiveRangeEdit::createEmptyInterval(), llvm::LiveRangeEdit::empty(), and llvm::LiveRangeEdit::size().

Referenced by splitSingleBlock().

◆ overlapIntv()

void SplitEditor::overlapIntv	(	SlotIndex	Start,
		SlotIndex	End
	)

overlapIntv - Indicate that all instructions in range should use the open interval, but also let the complement interval be live.

This doubles the register pressure, but is sometimes required to deal with register uses after the last valid split point.

The Start index should be a return value from a leaveIntv* call, and End should be in the same basic block. The parent interval must have the same value across the range.

Definition at line 827 of file SplitKit.cpp.

Referenced by splitSingleBlock().

◆ reset()

void SplitEditor::reset	(	LiveRangeEdit &	LRE,
		ComplementSpillMode	SM = `SM_Partition`
	)

reset - Prepare for a new split.

Definition at line 376 of file SplitKit.cpp.

References llvm::LiveRangeEdit::anyRematerializable(), llvm::DenseMapBase< DerivedT, KeyT, ValueT, KeyInfoT, BucketT >::clear(), llvm::IntervalMap< KeyT, ValT, N, Traits >::clear(), llvm::VirtRegMap::getMachineFunction(), llvm::LiveIntervals::getSlotIndexes(), llvm::LiveIntervals::getVNInfoAllocator(), and llvm::LiveRangeCalc::reset().

◆ selectIntv()

void SplitEditor::selectIntv ( unsigned Idx )

selectIntv - Select a previously opened interval index.

Definition at line 685 of file SplitKit.cpp.

References assert(), llvm::dbgs(), LLVM_DEBUG, and llvm::size().

◆ splitLiveThroughBlock()

void SplitEditor::splitLiveThroughBlock	(	unsigned	MBBNum,
		unsigned	IntvIn,
		SlotIndex	LeaveBefore,
		unsigned	IntvOut,
		SlotIndex	EnterAfter
	)

splitLiveThroughBlock - Split CurLI in the given block such that it enters the block in IntvIn and leaves it in IntvOut.

There may be uses in the block, but they will be ignored when placing split points.

Parameters

MBBNum	Block number.
IntvIn	Interval index entering the block.
LeaveBefore	When set, leave IntvIn before this point.
IntvOut	Interval index leaving the block.
EnterAfter	When set, enter IntvOut after this point.

Definition at line 1600 of file SplitKit.cpp.

◆ splitRegInBlock()

void SplitEditor::splitRegInBlock	(	const SplitAnalysis::BlockInfo &	BI,
		unsigned	IntvIn,
		SlotIndex	LeaveBefore
	)

splitRegInBlock - Split CurLI in the given block such that it enters the block in IntvIn and leaves it on the stack (or not at all).

Split points are placed in a way that avoids putting uses in the stack interval. This may require creating a local interval when there is interference.

Parameters

BI	Block descriptor.
IntvIn	Interval index entering the block. Not 0.
LeaveBefore	When set, leave IntvIn before this point.

Definition at line 1703 of file SplitKit.cpp.

◆ splitRegOutBlock()

void SplitEditor::splitRegOutBlock	(	const SplitAnalysis::BlockInfo &	BI,
		unsigned	IntvOut,
		SlotIndex	EnterAfter
	)

splitRegOutBlock - Split CurLI in the given block such that it enters the block on the stack (or isn't live-in at all) and leaves it in IntvOut.

Split points are placed to avoid interference and such that the uses are not in the stack interval. This may require creating a local interval when there is interference.

Parameters

BI	Block descriptor.
IntvOut	Interval index leaving the block.
EnterAfter	When set, enter IntvOut after this point.

Definition at line 1796 of file SplitKit.cpp.

◆ splitSingleBlock()

void SplitEditor::splitSingleBlock ( const SplitAnalysis::BlockInfo & BI )

splitSingleBlock - Split CurLI into a separate live interval around the uses in a single block.

This is intended to be used as part of a larger split, and doesn't call finish().

Definition at line 1574 of file SplitKit.cpp.

References enterIntvBefore(), llvm::SplitAnalysis::BlockInfo::FirstInstr, llvm::MachineBasicBlock::getNumber(), llvm::SplitAnalysis::BlockInfo::LastInstr, leaveIntvAfter(), leaveIntvBefore(), llvm::SplitAnalysis::BlockInfo::LiveOut, llvm::SplitAnalysis::BlockInfo::MBB, openIntv(), overlapIntv(), and useIntv().

◆ useIntv() [1/2]

void SplitEditor::useIntv ( const MachineBasicBlock & MBB )

useIntv - indicate that all instructions in MBB should use OpenLI.

Definition at line 747 of file SplitKit.cpp.

References llvm::LiveIntervals::getMBBEndIdx(), and llvm::LiveIntervals::getMBBStartIdx().

Referenced by splitSingleBlock().

◆ useIntv() [2/2]

void SplitEditor::useIntv	(	SlotIndex	Start,
		SlotIndex	End
	)

useIntv - indicate that all instructions in range should use OpenLI.

Definition at line 751 of file SplitKit.cpp.

The documentation for this class was generated from the following files:

lib/CodeGen/SplitKit.h
lib/CodeGen/SplitKit.cpp

Public Types

Public Member Functions

Detailed Description

Member Enumeration Documentation

◆ ComplementSpillMode

Constructor & Destructor Documentation

◆ SplitEditor()

Member Function Documentation

◆ currentIntv()

◆ dump()

◆ enterIntvAfter()

◆ enterIntvAtEnd()

◆ enterIntvBefore()

◆ finish()

◆ leaveIntvAfter()

◆ leaveIntvAtTop()

◆ leaveIntvBefore()

◆ openIntv()

◆ overlapIntv()

◆ reset()

◆ selectIntv()

◆ splitLiveThroughBlock()

◆ splitRegInBlock()

◆ splitRegOutBlock()

◆ splitSingleBlock()

◆ useIntv() [1/2]

◆ useIntv() [2/2]