You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 17:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Tue Mar 31, 2026 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2748242221187,22sleep70-21swapper/707:07:467
2749602220162,46sleep00-21swapper/007:09:400
2747492220183,24sleep60-21swapper/607:06:406
2748742219165,18sleep10-21swapper/107:08:281
2747392217185,21sleep50-21swapper/507:06:315
2749552209176,21sleep40-21swapper/407:09:364
2747922209177,20sleep20-21swapper/207:07:172
2747552207174,21sleep30-21swapper/307:06:453
3079022540,0sleep50-21swapper/508:05:015
27522399340,16cyclictest0-21swapper/708:59:117
27522399340,16cyclictest0-21swapper/707:42:187
27522399340,16cyclictest0-21swapper/707:31:197
27522399286,4cyclictest0-21swapper/709:43:077
27522399260,25cyclictest390620-21apt10:30:007
275216992620,5cyclictest0-21swapper/407:40:004
275216992519,5cyclictest0-21swapper/410:10:004
27521699250,21cyclictest0-21swapper/412:05:114
27521699250,1cyclictest281967-21apt-get07:20:114
27521699250,1cyclictest0-21swapper/411:10:114
27520899250,24cyclictest442350-21sendmail12:00:002
27519899253,1cyclictest0-21swapper/007:35:000
27519899250,24cyclictest0-21swapper/007:25:110
27522399247,14cyclictest408175-21cat11:00:007
27521899240,23cyclictest0-21swapper/510:50:115
275216992421,3cyclictest0-21swapper/410:55:134
27521699240,23cyclictest0-21swapper/409:30:014
27521699240,1cyclictest296267-21apt-get07:45:124
27521699240,1cyclictest0-21swapper/408:55:114
275203992423,1cyclictest0-21swapper/109:20:121
275203992421,3cyclictest0-21swapper/112:10:001
27519899240,23cyclictest0-21swapper/011:00:010
27522399230,22cyclictest356086-21munin-run09:30:007
27522199230,1cyclictest0-21swapper/612:35:006
27521899230,22cyclictest385345-21apt-get10:20:115
275216992321,2cyclictest0-21swapper/407:55:124
275216992321,1cyclictest364926-21munin-run09:45:014
275216992321,1cyclictest287252-21awk07:30:004
275216992320,3cyclictest0-21swapper/409:10:104
275216992317,5cyclictest0-21swapper/407:20:004
27521699230,22cyclictest293417-21apt-get07:40:124
27521699230,1cyclictest0-21swapper/410:20:004
275212992321,1cyclictest0-21swapper/311:15:123
27521299230,22cyclictest0-21swapper/310:05:133
27520899230,22cyclictest333651-21apt-get08:50:092
275203992321,1cyclictest0-21swapper/111:25:121
275223992221,1cyclictest359360-21apt-get09:35:137
275223992221,1cyclictest0-21swapper/707:20:007
27522399220,22cyclictest387798-21basename10:25:007
27522399220,21cyclictest345077-21apt-get09:10:117
27522399220,21cyclictest322232-21apt-get08:30:147
27522399220,21cyclictest0-21swapper/711:45:117
27522399220,21cyclictest0-21swapper/711:40:117
27522399220,21cyclictest0-21swapper/709:55:127
275221992221,1cyclictest287672-21apt-get07:30:136
275221992221,1cyclictest0-21swapper/611:20:116
275221992221,0cyclictest0-21swapper/607:10:126
275221992220,1cyclictest0-21swapper/612:05:126
275221992220,1cyclictest0-21swapper/608:35:116
275221992219,3cyclictest399218-21awk10:45:006
27522199220,21cyclictest0-21swapper/612:35:106
27522199220,21cyclictest0-21swapper/609:45:126
275218992220,2cyclictest350380-21awk09:20:005
27521899220,21cyclictest0-21swapper/511:15:115
27521899220,21cyclictest0-21swapper/510:30:125
27521899220,21cyclictest0-21swapper/509:55:125
27521899220,21cyclictest0-21swapper/509:35:135
27521899220,1cyclictest442344-21munin-run12:00:005
27521899220,1cyclictest0-21swapper/512:40:005
275216992222,0cyclictest0-21swapper/411:00:014
275216992221,1cyclictest0-21swapper/408:05:124
275216992221,1cyclictest0-21swapper/408:05:124
275216992220,1cyclictest454037-21munin-run12:20:004
27521699220,21cyclictest463023-21apt-get12:35:104
27521699220,21cyclictest0-21swapper/412:25:114
27521699220,21cyclictest0-21swapper/412:00:124
27521699220,21cyclictest0-21swapper/408:30:134
275212992221,1cyclictest0-21swapper/312:30:103
275212992221,1cyclictest0-21swapper/309:45:123
275212992220,1cyclictest433791-21munin-run11:45:003
275212992220,1cyclictest345077-21apt-get09:10:103
275212992220,1cyclictest0-21swapper/307:20:103
27521299220,21cyclictest361799-21perf09:40:013
27521299220,21cyclictest0-21swapper/308:30:193
27521299220,21cyclictest0-21swapper/307:10:113
27521299220,1cyclictest0-21swapper/311:00:003
275208992221,1cyclictest0-21swapper/207:15:132
275208992220,1cyclictest0-21swapper/207:30:122
27520899220,21cyclictest0-21swapper/212:25:112
27520899220,21cyclictest0-21swapper/211:05:122
27520899220,21cyclictest0-21swapper/209:45:182
27520899220,21cyclictest0-21swapper/209:05:132
27520899220,1cyclictest450916-21awk12:15:002
27520899220,1cyclictest327956-21apt-get08:40:122
27520899220,0cyclictest0-21swapper/210:30:122
275203992221,1cyclictest382472-21apt-get10:15:131
27520399220,22cyclictest0-21swapper/107:20:111
27520399220,21cyclictest371047-21apt-get09:55:121
27520399220,21cyclictest0-21swapper/108:20:121
27520399220,21cyclictest0-21swapper/108:15:131
27520399220,1cyclictest454032-21sendmail12:20:001
27520399220,1cyclictest0-21swapper/109:20:001
275198992221,1cyclictest0-21swapper/012:15:000
275198992220,1cyclictest0-21swapper/012:35:000
27519899220,21cyclictest0-21swapper/011:40:110
27519899220,1cyclictest302230-21apt-get07:55:120
27519899220,1cyclictest0-21swapper/012:20:110
275223992121,0cyclictest0-21swapper/712:25:117
275223992121,0cyclictest0-21swapper/712:05:177
275223992121,0cyclictest0-21swapper/707:55:127
275223992120,1cyclictest393479-21munin-run10:35:007
275223992120,1cyclictest298891-21awk07:50:007
275223992120,1cyclictest0-21swapper/708:05:127
275223992120,1cyclictest0-21swapper/708:05:127
27522399210,20cyclictest0-21swapper/711:15:127
27522399210,20cyclictest0-21swapper/708:20:127
27522399210,0cyclictest0-21swapper/710:05:137
275221992121,0cyclictest0-21swapper/608:15:126
275221992121,0cyclictest0-21swapper/608:05:126
275221992121,0cyclictest0-21swapper/608:05:126
275221992120,1cyclictest0-21swapper/608:45:136
27522199210,1cyclictest316529-21apt-get08:20:126
27522199210,0cyclictest0-21swapper/610:15:136
275218992121,0cyclictest0-21swapper/508:55:115
275218992121,0cyclictest0-21swapper/508:25:145
275218992121,0cyclictest0-21swapper/507:55:005
275218992121,0cyclictest0-21swapper/507:35:145
275218992120,1cyclictest408456-21apt-get11:00:125
27521899210,21cyclictest0-21swapper/509:10:005
27521899210,21cyclictest0-21swapper/507:50:005
27521899210,20cyclictest0-21swapper/508:50:095
27521899210,0cyclictest0-21swapper/511:30:115
27521899210,0cyclictest0-21swapper/511:10:125
27521899210,0cyclictest0-21swapper/509:50:125
275216992121,0cyclictest0-21swapper/412:10:134
275216992119,2cyclictest0-21swapper/408:50:004
27521699210,21cyclictest0-21swapper/407:50:014
27521699210,20cyclictest0-21swapper/410:50:114
27521699210,1cyclictest0-21swapper/412:35:004
275212992121,0cyclictest0-21swapper/311:55:123
275212992120,1cyclictest459752-21turbostat12:30:003
275212992120,1cyclictest364931-21perf09:45:013
275212992120,1cyclictest0-21swapper/312:15:013
275212992120,1cyclictest0-21swapper/308:15:133
275212992118,2cyclictest344660-21munin-run09:10:003
27521299210,0cyclictest0-21swapper/311:00:123
27521299210,0cyclictest0-21swapper/310:25:123
275208992121,0cyclictest0-21swapper/210:15:132
275208992121,0cyclictest0-21swapper/209:35:132
275208992121,0cyclictest0-21swapper/209:10:112
275208992119,2cyclictest448080-21perf12:10:002
27520899210,21cyclictest0-21swapper/208:55:112
27520899210,21cyclictest0-21swapper/207:45:122
27520899210,0cyclictest0-21swapper/212:20:122
27520899210,0cyclictest0-21swapper/209:15:122
275203992120,1cyclictest72350irq/124-eno110:35:181
275203992120,1cyclictest460172-21apt-get12:30:101
275203992120,1cyclictest275521-21apt-get07:10:121
275203992120,1cyclictest169301-21kworker/u16:2-ext4-rsv-conversion11:55:011
275203992120,1cyclictest0-21swapper/111:00:011
275203992120,1cyclictest0-21swapper/108:30:001
275203992120,1cyclictest0-21swapper/108:05:121
275203992120,1cyclictest0-21swapper/108:05:121
275203992120,1cyclictest0-21swapper/107:35:001
275203992119,1cyclictest376352-21munin-run10:05:011
275203992119,1cyclictest0-21swapper/109:45:121
275203992119,1cyclictest0-21swapper/108:45:131
275203992119,1cyclictest0-21swapper/108:00:111
27520399210,20cyclictest0-21swapper/110:45:121
27520399210,0cyclictest0-21swapper/111:45:111
27520399210,0cyclictest0-21swapper/111:20:111
27520399210,0cyclictest0-21swapper/109:00:101
27520399210,0cyclictest0-21swapper/108:10:131
27520399210,0cyclictest0-21swapper/108:10:131
27520399210,0cyclictest0-21swapper/107:35:131
275198992120,1cyclictest0-21swapper/010:40:120
275198992120,1cyclictest0-21swapper/008:45:130
275198992120,1cyclictest0-21swapper/008:10:120
275198992120,1cyclictest0-21swapper/008:10:120
275198992120,1cyclictest0-21swapper/008:00:110
275198992120,0cyclictest0-21swapper/009:45:120
275198992119,1cyclictest411307-21apt-get11:05:120
27519899210,1cyclictest419882-21apt-get11:20:110
27519899210,1cyclictest0-21swapper/008:10:000
27519899210,1cyclictest0-21swapper/008:10:000
27519899210,0cyclictest0-21swapper/009:55:120
27519899210,0cyclictest0-21swapper/008:40:120
275223992020,0cyclictest350804-21apt-get09:20:117
275223992020,0cyclictest0-21swapper/709:50:127
275223992020,0cyclictest0-21swapper/709:30:117
275223992020,0cyclictest0-21swapper/708:50:097
27522399200,19cyclictest0-21swapper/710:10:117
275221992020,0cyclictest0-21swapper/611:40:116
275221992020,0cyclictest0-21swapper/609:20:126
275221992020,0cyclictest0-21swapper/608:55:126
275221992020,0cyclictest0-21swapper/608:25:146
275221992020,0cyclictest0-21swapper/607:55:126
275221992019,1cyclictest0-21swapper/611:55:116
275221992019,1cyclictest0-21swapper/610:50:116
275221992019,1cyclictest0-21swapper/610:25:006
275221992019,1cyclictest0-21swapper/609:55:126
275221992019,1cyclictest0-21swapper/608:40:126
27522199200,1cyclictest290524-21apt-get07:35:136
27522199200,0cyclictest0-21swapper/610:55:136
27522199200,0cyclictest0-21swapper/609:35:136
275218992020,0cyclictest0-21swapper/512:20:115
275218992020,0cyclictest0-21swapper/512:10:135
275218992020,0cyclictest0-21swapper/512:00:125
275218992020,0cyclictest0-21swapper/510:10:115
275218992020,0cyclictest0-21swapper/509:25:125
275218992020,0cyclictest0-21swapper/509:10:115
275218992019,1cyclictest454013-21cron12:20:005
275218992018,1cyclictest0-21swapper/511:45:115
27521899200,0cyclictest0-21swapper/508:30:135
27521899200,0cyclictest0-21swapper/507:30:125
275216992020,0cyclictest0-21swapper/411:40:004
275216992018,1cyclictest382051-21awk10:15:004
27521699200,2cyclictest306439-21awk08:00:184
275212992020,0cyclictest0-21swapper/312:20:113
275212992020,0cyclictest0-21swapper/312:00:123
275212992020,0cyclictest0-21swapper/311:10:123
275212992020,0cyclictest0-21swapper/310:35:103
275212992020,0cyclictest0-21swapper/307:25:123
275212992020,0cyclictest0-21swapper/307:15:133
275212992019,1cyclictest491rcuc/310:25:003
275212992019,1cyclictest425585-21apt-get11:30:113
275212992019,1cyclictest0-21swapper/307:50:013
275212992018,1cyclictest0-21swapper/311:50:003
275208992020,0cyclictest0-21swapper/212:20:002
275208992020,0cyclictest0-21swapper/211:45:122
275208992020,0cyclictest0-21swapper/211:35:142
275208992020,0cyclictest0-21swapper/210:40:122
275208992019,1cyclictest0-21swapper/211:15:002
27520899200,0cyclictest0-21swapper/211:20:112
275203992020,0cyclictest0-21swapper/110:50:111
27520399200,0cyclictest0-21swapper/108:55:111
275198992020,0cyclictest0-21swapper/009:30:020
275198992020,0cyclictest0-21swapper/009:20:120
275198992020,0cyclictest0-21swapper/008:50:090
275198992020,0cyclictest0-21swapper/007:50:120
275223991919,0cyclictest0-21swapper/712:15:197
275223991919,0cyclictest0-21swapper/711:50:117
275223991919,0cyclictest0-21swapper/707:10:127
275223991918,1cyclictest425165-21munin-run11:30:007
275221991918,1cyclictest358957-21awk09:35:016
275221991918,1cyclictest0-21swapper/611:50:116
275221991918,1cyclictest0-21swapper/609:15:126
275218991919,0cyclictest0-21swapper/511:50:125
275218991919,0cyclictest0-21swapper/508:40:125
275218991919,0cyclictest0-21swapper/508:10:135
275218991919,0cyclictest0-21swapper/508:10:135
275218991918,0cyclictest0-21swapper/508:20:125
275216991919,0cyclictest0-21swapper/410:45:134
275216991919,0cyclictest0-21swapper/410:35:104
275216991919,0cyclictest0-21swapper/410:00:134
27521699190,18cyclictest0-21swapper/411:55:124
27521699190,18cyclictest0-21swapper/410:25:004
275212991919,0cyclictest0-21swapper/311:20:113
275212991919,0cyclictest0-21swapper/311:05:123
275212991919,0cyclictest0-21swapper/309:55:123
275212991919,0cyclictest0-21swapper/309:50:123
275212991919,0cyclictest0-21swapper/309:25:123
275212991919,0cyclictest0-21swapper/308:45:133
275212991919,0cyclictest0-21swapper/308:20:133
275212991918,1cyclictest0-21swapper/310:20:003
275212991917,1cyclictest292988-21awk07:40:003
275208991919,0cyclictest0-21swapper/211:00:112
275208991919,0cyclictest0-21swapper/207:20:102
275208991917,2cyclictest363-21systemd-journal10:50:002
275208991917,2cyclictest287260-21awk07:30:002
275203991919,0cyclictest0-21swapper/109:40:011
275203991918,1cyclictest0-21swapper/112:25:111
27520399190,1cyclictest430922-21munin-run11:40:001
275198991919,0cyclictest0-21swapper/009:05:130
275198991919,0cyclictest0-21swapper/009:00:100
275198991919,0cyclictest0-21swapper/008:30:130
275198991919,0cyclictest0-21swapper/007:15:000
275198991918,1cyclictest442783-21apt-get12:00:120
275198991918,1cyclictest376771-21apt-get10:05:130
275198991918,1cyclictest361783-21apt-get09:40:020
275198991918,1cyclictest0-21swapper/011:40:000
275198991918,1cyclictest0-21swapper/010:55:120
275223991818,0cyclictest0-21swapper/712:10:137
275223991818,0cyclictest0-21swapper/711:20:117
275223991818,0cyclictest0-21swapper/708:45:137
275223991818,0cyclictest0-21swapper/708:25:147
275221991818,0cyclictest0-21swapper/612:25:116
275221991818,0cyclictest0-21swapper/611:00:116
275221991818,0cyclictest0-21swapper/610:45:126
275221991817,1cyclictest456893-21idleruntime-cro12:25:006
275221991817,1cyclictest0-21swapper/610:00:136
275221991817,1cyclictest0-21swapper/609:40:136
275218991818,0cyclictest0-21swapper/511:20:115
275218991818,0cyclictest0-21swapper/510:15:135
275218991818,0cyclictest0-21swapper/509:20:125
275218991818,0cyclictest0-21swapper/509:00:105
275218991818,0cyclictest0-21swapper/508:15:135
275218991818,0cyclictest0-21swapper/507:20:115
275218991817,1cyclictest0-21swapper/511:40:005
275218991816,1cyclictest0-21swapper/511:25:125
275216991818,0cyclictest0-21swapper/411:25:124
275216991818,0cyclictest0-21swapper/409:35:134
275216991818,0cyclictest0-21swapper/408:40:124
275216991818,0cyclictest0-21swapper/408:15:124
275216991818,0cyclictest0-21swapper/407:15:004
275216991816,2cyclictest0-21swapper/409:55:124
27521699180,3cyclictest340692-21collect209:00:174
27521699180,1cyclictest417006-21apt-get11:15:114
27521699180,1cyclictest0-21swapper/409:50:124
27521699180,1cyclictest0-21swapper/408:35:234
27521699180,17cyclictest0-21swapper/410:40:194
275212991818,0cyclictest0-21swapper/310:50:123
275212991818,0cyclictest0-21swapper/308:35:113
275212991818,0cyclictest0-21swapper/308:00:113
275212991818,0cyclictest0-21swapper/307:45:123
275212991816,1cyclictest0-21swapper/307:30:133
275208991818,0cyclictest0-21swapper/208:25:142
275208991818,0cyclictest0-21swapper/208:00:112
275208991817,1cyclictest387793-21awk10:25:002
27520899180,17cyclictest0-21swapper/211:50:112
275203991818,0cyclictest0-21swapper/109:50:121
275203991817,1cyclictest0-21swapper/111:10:111
275203991817,1cyclictest0-21swapper/107:55:121
275203991816,1cyclictest0-21swapper/111:55:111
275198991818,0cyclictest0-21swapper/008:20:120
275198991817,1cyclictest463023-21apt-get12:35:100
275198991817,1cyclictest319382-21apt-get08:25:140
275198991817,0cyclictest0-21swapper/010:15:130
27519899180,14cyclictest296267-21apt-get07:45:110
275223991717,0cyclictest0-21swapper/711:55:127
275223991717,0cyclictest0-21swapper/711:35:147
275223991717,0cyclictest0-21swapper/710:35:107
275223991717,0cyclictest0-21swapper/709:15:127
275223991717,0cyclictest0-21swapper/708:10:127
275223991717,0cyclictest0-21swapper/708:10:127
27522399170,16cyclictest299380-21apt-get07:50:127
275221991717,0cyclictest0-21swapper/611:10:116
275218991717,0cyclictest0-21swapper/509:30:105
275218991717,0cyclictest0-21swapper/507:25:125
275218991716,1cyclictest881-21mta-sts-daemon12:10:005
275218991716,1cyclictest0-21swapper/510:00:125
275216991716,1cyclictest0-21swapper/411:35:004
275216991715,2cyclictest0-21swapper/408:50:094
275216991715,1cyclictest431360-21apt-get11:40:114
275216991715,1cyclictest0-21swapper/412:25:004
27521699170,1cyclictest434209-21apt-get11:45:114
27521699170,1cyclictest310803-21apt-get08:10:124
27521699170,1cyclictest310803-21apt-get08:10:124
27521699170,1cyclictest0-21swapper/409:45:184
27521699170,1cyclictest0-21swapper/409:05:174
27521699170,0cyclictest0-21swapper/407:30:124
275212991717,0cyclictest0-21swapper/311:35:143
275212991717,0cyclictest0-21swapper/308:25:143
275212991717,0cyclictest0-21swapper/308:10:003
275212991717,0cyclictest0-21swapper/308:10:003
275212991715,1cyclictest379620-21apt-get10:10:113
275208991717,0cyclictest419453-21systemctl11:20:002
275208991717,0cyclictest0-21swapper/210:00:132
275208991717,0cyclictest0-21swapper/208:15:122
275208991717,0cyclictest0-21swapper/207:50:122
275208991717,0cyclictest0-21swapper/207:40:122
275208991717,0cyclictest0-21swapper/207:35:132
275208991716,1cyclictest390639-21turbostat10:30:002
27520899170,16cyclictest0-21swapper/208:35:122
275203991716,1cyclictest0-21swapper/112:35:101
275198991717,0cyclictest0-21swapper/007:35:130
275198991716,1cyclictest434209-21apt-get11:45:110
275198991716,1cyclictest281967-21apt-get07:20:110
275223991616,0cyclictest0-21swapper/711:30:117
275223991616,0cyclictest0-21swapper/708:40:127
275223991616,0cyclictest0-21swapper/708:35:117
275223991616,0cyclictest0-21swapper/707:35:137
275223991613,2cyclictest375563-21python310:00:237
27522399160,16cyclictest415348-21ld11:10:177
27522399160,16cyclictest0-21swapper/712:38:517
27522399160,16cyclictest0-21swapper/710:16:047
27522399160,16cyclictest0-21swapper/708:04:167
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional