[Kafka] Kafka Config Ackmode

BATCH	Commit the offsets of all records returned by the previous poll after they all have been processed by the listener.
COUNT	Commit pending offsets after ackCount has been exceeded.
COUNT_TIME	Commit pending offsets after ackCount has been exceeded or after ackTime has elapsed.
MANUAL	Listener is responsible for acking - use a AcknowledgingMessageListener; acks will be queued and offsets will be committed when all the records returned by the previous poll have been processed by the listener.
MANUAL_IMMEDIATE	Listener is responsible for acking - use a AcknowledgingMessageListener; the commit will be performed immediately if the Acknowledgment is acknowledged on the calling consumer thread; otherwise, the acks will be queued and offsets will be committed when all the records returned by the previous poll have been processed by the listener; results will be indeterminate if you sometimes acknowledge on the calling thread and sometimes not.
RECODE	Commit the offset after each record is processed by the listener.
TIME	Commit pending offsets after ackTime has elapsed.

 

AckMode 설정 없이 ENABLE_AUTO_COMMIT_CONFIG = true로 하니

데이터 중복 등의 토픽 메세지 실패 시에 커밋이 안되고 무한루프 되는 상황이 발생.

 

AckMode를 MANUAL로 돌리고 setRecoveryCallback설정을 통해 실패 로직 처리를 하고나니 이번에는 성공시에 커밋이 안되는 상황이 발생..

 

구글링 해보니 MANUAL, MANUAL_IMMEDIATE는  AcknowledgingMessageListener 혹은 BatchAcknowledgingMessageListener를 사용해야한다고 하여 현재 프로젝트에 맞추려고 노력해보았지만 잘 안되었다..

 

혹시나하고 리스너의 마지막 단계에 acknowledgment.acknowledge()를 넣어주니 성공하였다.

@Override
@KafkaListener(id = "아이디",
			   topics = "토픽명", 
			   groupId = "sampleGroup", 
			   containerFactory = "kafkaListenerContainerFactory",
			   autoStartup = "false")	
public void registerEmp(List<Map<String, Object>> reqList, Acknowledgment acknowledgment) throws Exception {

    for( int i=0 ; i< reqList.size(); i++) {
        Map<String, Object> reqMap = new HashMap<String, Object>();
        reqMap = reqList.get(i);	

        //업무 로직 작성

        acknowledgment.acknowledge();
    }
}

 

테스트 중 추가적인 문제가 없는지는 확인해봐야 알 것 같다.