You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 04:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot4s.osadl.org (updated Fri Mar 13, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6936962253176,25sleep30-21swapper/319:06:143
6939522222162,19sleep40-21swapper/419:09:534
6938232220187,21sleep60-21swapper/619:08:016
6938512216189,17sleep50-21swapper/519:08:245
6939462215181,21sleep70-21swapper/719:09:477
6938572215181,22sleep20-21swapper/219:08:302
6936942209176,21sleep10-21swapper/119:06:121
6938262208175,21sleep00-21swapper/019:08:030
694230992620,5cyclictest764138-21latency_hist21:10:007
69423099250,24cyclictest0-21swapper/720:55:137
69422399250,24cyclictest723368-21systemctl20:00:014
69422399250,24cyclictest723368-21systemctl20:00:004
69421499250,24cyclictest750027-21apt-get20:45:121
694230992424,0cyclictest0-21swapper/721:50:127
69423099240,1cyclictest793448-21apt-get22:00:117
69422899240,23cyclictest0-21swapper/621:10:016
69422599240,23cyclictest0-21swapper/523:45:105
69421999240,23cyclictest0-21swapper/322:55:113
694230992322,1cyclictest779150-21apt-get21:35:107
694230992321,1cyclictest882821-21apt-get00:35:137
694230992321,1cyclictest882821-21apt-get00:35:137
694230992321,1cyclictest865687-21apt-get00:05:137
694230992321,1cyclictest804422-21sh22:19:597
694230992319,4cyclictest0-21swapper/719:55:007
694230992319,3cyclictest0-21swapper/720:15:007
694230992318,4cyclictest0-21swapper/700:25:017
694230992316,6cyclictest0-21swapper/720:30:017
69423099230,22cyclictest767233-21cron21:15:007
69423099230,22cyclictest0-21swapper/722:35:007
69423099230,22cyclictest0-21swapper/700:30:127
69422899230,2cyclictest709061-21cron19:35:006
694225992323,0cyclictest0-21swapper/500:20:115
694225992321,1cyclictest731950-21idleruntime-cro20:15:015
69422599230,22cyclictest0-21swapper/520:35:145
69422599230,22cyclictest0-21swapper/519:40:125
694223992323,0cyclictest0-21swapper/423:00:124
694223992322,1cyclictest0-21swapper/400:15:114
69422399230,3cyclictest793017-21dump-pmu-power22:00:004
69422399230,22cyclictest0-21swapper/422:10:104
69422399230,22cyclictest0-21swapper/421:20:004
69422399230,22cyclictest0-21swapper/419:35:014
694219992321,2cyclictest363-21systemd-journal20:35:003
694219992321,1cyclictest0-21swapper/322:15:103
69421999230,22cyclictest793448-21apt-get22:00:123
69421999230,22cyclictest0-21swapper/319:55:133
69421999230,22cyclictest0-21swapper/319:55:123
69421499230,22cyclictest0-21swapper/123:10:101
69421499230,22cyclictest0-21swapper/122:50:121
69421499230,22cyclictest0-21swapper/121:15:111
694212992321,1cyclictest737913-21turbostat20:25:000
69421299230,2cyclictest861150-21ntpq23:55:170
69421299230,22cyclictest0-21swapper/022:15:100
694230992222,0cyclictest0-21swapper/723:05:117
694230992218,3cyclictest0-21swapper/720:40:107
694230992217,4cyclictest0-21swapper/719:55:137
694230992217,4cyclictest0-21swapper/719:55:137
69423099220,21cyclictest0-21swapper/722:49:597
69423099220,21cyclictest0-21swapper/722:40:117
69423099220,21cyclictest0-21swapper/720:45:117
69423099220,21cyclictest0-21swapper/719:20:117
69423099220,1cyclictest752877-21apt-get20:50:137
69423099220,1cyclictest0-21swapper/700:10:127
69423099220,18cyclictest0-21swapper/722:25:137
694228992220,1cyclictest877-21mta-sts-daemon20:30:136
694228992220,1cyclictest0-21swapper/620:55:136
69422899220,22cyclictest714809-21perf19:45:016
69422899220,21cyclictest0-21swapper/622:25:126
69422899220,21cyclictest0-21swapper/620:40:106
69422899220,21cyclictest0-21swapper/619:40:006
69422899220,1cyclictest874264-21apt-get00:20:116
69422899220,1cyclictest836813-21apt-get23:15:116
694225992221,1cyclictest0-21swapper/523:25:135
694225992221,1cyclictest0-21swapper/520:25:015
694225992220,1cyclictest755729-21apt-get20:55:125
694225992220,1cyclictest726648-21apt-get20:05:135
69422599220,22cyclictest0-21swapper/521:10:125
69422599220,22cyclictest0-21swapper/521:05:015
69422599220,22cyclictest0-21swapper/519:15:005
694223992221,1cyclictest0-21swapper/420:40:114
694223992220,1cyclictest0-21swapper/419:45:004
69422399220,21cyclictest0-21swapper/423:54:594
69422399220,21cyclictest0-21swapper/422:30:114
69422399220,21cyclictest0-21swapper/421:05:014
694219992221,1cyclictest0-21swapper/300:25:163
694219992221,1cyclictest0-21swapper/300:00:113
69421999220,21cyclictest694496-21apt-get19:10:123
69421999220,21cyclictest0-21swapper/323:55:133
69421999220,21cyclictest0-21swapper/323:25:133
69421999220,21cyclictest0-21swapper/320:55:123
69421999220,21cyclictest0-21swapper/320:10:113
69421999220,1cyclictest0-21swapper/322:30:003
69421799220,22cyclictest761034-21munin-run21:05:002
69421799220,21cyclictest0-21swapper/223:00:112
69421799220,21cyclictest0-21swapper/220:10:102
69421799220,21cyclictest0-21swapper/200:25:152
69421799220,1cyclictest0-21swapper/200:20:002
69421799220,0cyclictest0-21swapper/222:45:132
694214992221,1cyclictest761082-21apt-config21:05:001
694214992220,2cyclictest781606-21awk21:40:001
69421499220,22cyclictest833277-21awk23:09:591
69421499220,22cyclictest0-21swapper/122:39:591
69421499220,21cyclictest0-21swapper/123:50:121
69421499220,21cyclictest0-21swapper/122:20:111
69421499220,21cyclictest0-21swapper/122:00:121
694212992222,0cyclictest0-21swapper/021:15:110
694212992221,1cyclictest0-21swapper/019:45:110
694212992220,1cyclictest871387-21apt-get00:15:120
694212992220,1cyclictest0-21swapper/000:25:010
69421299220,22cyclictest761038-21perf21:05:010
69421299220,22cyclictest700542-21idleruntime-cro19:20:010
69421299220,21cyclictest0-21swapper/021:40:110
69421299220,1cyclictest810576-21apt-get22:30:120
694230992120,1cyclictest0-21swapper/700:20:007
694230992116,4cyclictest0-21swapper/720:35:137
694230992115,5cyclictest850965-21awk23:39:597
69423099210,20cyclictest709081-21munin-run19:35:007
69423099210,20cyclictest0-21swapper/723:10:107
69423099210,20cyclictest0-21swapper/719:35:117
69423099210,0cyclictest0-21swapper/723:00:127
694228992120,1cyclictest744307-21apt-get20:35:146
694228992120,1cyclictest0-21swapper/622:45:126
694228992120,0cyclictest0-21swapper/620:50:136
694228992119,1cyclictest0-21swapper/622:35:006
694228992119,1cyclictest0-21swapper/621:30:126
694228992119,1cyclictest0-21swapper/619:20:106
69422899210,21cyclictest0-21swapper/620:25:136
69422899210,21cyclictest0-21swapper/619:55:016
69422899210,21cyclictest0-21swapper/619:10:116
69422899210,0cyclictest0-21swapper/620:45:116
69422899210,0cyclictest0-21swapper/600:05:136
694225992121,0cyclictest0-21swapper/522:34:595
694225992121,0cyclictest0-21swapper/519:15:125
694225992120,1cyclictest776299-21apt-get21:30:125
694225992120,0cyclictest0-21swapper/520:15:125
69422599210,0cyclictest0-21swapper/523:20:125
694223992121,0cyclictest0-21swapper/420:25:014
694223992121,0cyclictest0-21swapper/420:10:114
694223992119,1cyclictest737908-21apt-get20:25:014
69422399210,5cyclictest0-21swapper/419:40:004
69422399210,21cyclictest0-21swapper/422:25:124
69422399210,20cyclictest0-21swapper/423:40:104
69422399210,0cyclictest0-21swapper/423:15:114
69422399210,0cyclictest0-21swapper/420:50:124
694219992121,0cyclictest0-21swapper/322:45:133
694219992121,0cyclictest0-21swapper/321:15:103
694219992120,1cyclictest0-21swapper/322:34:593
694219992120,0cyclictest0-21swapper/300:20:113
69421999210,0cyclictest0-21swapper/320:25:123
69421999210,0cyclictest0-21swapper/319:35:123
694217992121,0cyclictest0-21swapper/223:45:112
694217992121,0cyclictest0-21swapper/222:25:132
694217992121,0cyclictest0-21swapper/222:00:122
694217992121,0cyclictest0-21swapper/220:35:132
694217992120,1cyclictest0-21swapper/221:10:132
69421799210,21cyclictest0-21swapper/223:15:122
69421799210,21cyclictest0-21swapper/220:00:012
69421799210,21cyclictest0-21swapper/220:00:012
69421799210,20cyclictest0-21swapper/222:05:122
69421799210,20cyclictest0-21swapper/200:20:112
69421799210,0cyclictest0-21swapper/223:40:122
69421799210,0cyclictest0-21swapper/222:55:172
69421799210,0cyclictest0-21swapper/219:40:122
69421799210,0cyclictest0-21swapper/219:20:102
694214992121,0cyclictest0-21swapper/119:50:111
694214992120,1cyclictest827993-21apt-get23:00:111
694214992120,1cyclictest0-21swapper/121:00:011
694214992119,1cyclictest0-21swapper/120:20:191
69421499210,21cyclictest0-21swapper/100:25:211
69421499210,20cyclictest0-21swapper/122:40:101
694212992120,1cyclictest813690-21apt-get22:35:110
694212992120,1cyclictest700943-21apt-get19:20:110
694212992120,1cyclictest0-21swapper/021:40:000
694212992120,1cyclictest0-21swapper/021:20:130
694212992120,0cyclictest0-21swapper/023:10:100
69421299210,21cyclictest0-21swapper/000:30:000
69421299210,0cyclictest0-21swapper/020:20:000
694230992020,0cyclictest0-21swapper/723:50:127
694230992020,0cyclictest0-21swapper/722:55:127
694230992020,0cyclictest0-21swapper/721:25:137
694230992020,0cyclictest0-21swapper/719:25:127
694230992019,0cyclictest0-21swapper/723:30:117
69423099200,0cyclictest0-21swapper/723:25:147
694228992020,0cyclictest0-21swapper/623:25:136
694228992020,0cyclictest0-21swapper/622:35:116
694228992020,0cyclictest0-21swapper/622:20:106
694228992020,0cyclictest0-21swapper/619:15:136
694228992020,0cyclictest0-21swapper/600:00:116
694228992019,1cyclictest851381-21apt-get23:40:106
694228992019,1cyclictest0-21swapper/621:55:136
694228992018,1cyclictest885296-21awk00:40:016
694228992018,1cyclictest885296-21awk00:40:006
69422899200,0cyclictest0-21swapper/622:55:126
69422899200,0cyclictest0-21swapper/621:15:106
694225992020,0cyclictest0-21swapper/521:25:135
694225992020,0cyclictest0-21swapper/520:30:135
694225992020,0cyclictest0-21swapper/519:20:115
694225992020,0cyclictest0-21swapper/500:00:125
694225992019,1cyclictest862372-21munin-run00:00:005
694225992019,1cyclictest0-21swapper/523:35:115
694225992019,1cyclictest0-21swapper/523:05:005
694225992019,1cyclictest0-21swapper/522:09:595
694225992019,1cyclictest0-21swapper/521:40:115
694225992019,0cyclictest0-21swapper/523:40:115
694225992019,0cyclictest0-21swapper/520:00:105
69422599200,20cyclictest0-21swapper/519:50:115
69422599200,0cyclictest0-21swapper/520:40:105
694223992020,0cyclictest0-21swapper/421:10:024
694223992020,0cyclictest0-21swapper/420:55:124
694223992020,0cyclictest0-21swapper/420:45:114
694223992020,0cyclictest0-21swapper/420:05:134
694223992020,0cyclictest0-21swapper/419:55:014
694223992020,0cyclictest0-21swapper/400:25:164
694223992020,0cyclictest0-21swapper/400:20:114
694223992019,1cyclictest825120-21apt-get22:55:114
694223992019,1cyclictest0-21swapper/423:25:124
69422399200,20cyclictest0-21swapper/419:15:124
694219992020,0cyclictest0-21swapper/322:35:113
694219992020,0cyclictest0-21swapper/320:45:123
694219992020,0cyclictest0-21swapper/320:20:133
694219992020,0cyclictest0-21swapper/319:45:103
694219992020,0cyclictest0-21swapper/300:15:113
694219992019,1cyclictest0-21swapper/323:15:003
694219992019,1cyclictest0-21swapper/300:05:143
694219992019,0cyclictest712373-21apt-get19:40:113
69421999200,19cyclictest0-21swapper/321:35:113
69421999200,0cyclictest0-21swapper/321:40:123
694217992020,0cyclictest833268-21apt-get23:10:022
694217992020,0cyclictest0-21swapper/223:20:132
694217992020,0cyclictest0-21swapper/220:40:112
694217992018,1cyclictest0-21swapper/222:35:002
69421799200,19cyclictest0-21swapper/219:10:122
69421799200,0cyclictest0-21swapper/222:20:122
694214992020,0cyclictest0-21swapper/123:40:111
694214992020,0cyclictest0-21swapper/123:30:111
694214992020,0cyclictest0-21swapper/123:25:131
694214992020,0cyclictest0-21swapper/120:25:131
694214992020,0cyclictest0-21swapper/119:30:121
694214992020,0cyclictest0-21swapper/119:25:121
694214992020,0cyclictest0-21swapper/100:35:131
694214992020,0cyclictest0-21swapper/100:35:131
69421499200,20cyclictest0-21swapper/123:55:121
694212992020,0cyclictest0-21swapper/022:50:120
694212992020,0cyclictest0-21swapper/022:20:100
694212992020,0cyclictest0-21swapper/021:55:130
694212992020,0cyclictest0-21swapper/021:50:130
694212992020,0cyclictest0-21swapper/021:30:110
694212992020,0cyclictest0-21swapper/020:50:130
694212992020,0cyclictest0-21swapper/020:35:130
694212992020,0cyclictest0-21swapper/019:40:120
694212992020,0cyclictest0-21swapper/019:30:120
694212992020,0cyclictest0-21swapper/000:35:130
694212992020,0cyclictest0-21swapper/000:35:120
694212992019,1cyclictest0-21swapper/020:10:010
694212992019,1cyclictest0-21swapper/019:55:130
694212992019,1cyclictest0-21swapper/019:55:120
69421299200,0cyclictest0-21swapper/021:10:120
69421299200,0cyclictest0-21swapper/000:00:110
694230991919,0cyclictest0-21swapper/723:15:117
694230991919,0cyclictest0-21swapper/721:20:137
694230991919,0cyclictest0-21swapper/700:00:007
694230991918,1cyclictest0-21swapper/719:45:127
69423099190,1cyclictest0-21swapper/723:20:017
694228991919,0cyclictest0-21swapper/623:50:136
694228991919,0cyclictest0-21swapper/623:20:016
694228991919,0cyclictest0-21swapper/622:15:116
694228991919,0cyclictest0-21swapper/621:20:136
694228991919,0cyclictest0-21swapper/621:05:116
694228991919,0cyclictest0-21swapper/619:45:116
694228991917,2cyclictest773448-21apt-get21:25:136
694225991919,0cyclictest0-21swapper/523:10:115
694225991919,0cyclictest0-21swapper/522:35:115
694225991919,0cyclictest0-21swapper/521:50:125
694225991919,0cyclictest0-21swapper/520:50:125
694225991919,0cyclictest0-21swapper/519:45:115
694225991918,1cyclictest750027-21apt-get20:45:115
694225991918,1cyclictest0-21swapper/523:30:125
694225991917,2cyclictest877120-21apt-get00:25:155
694225991917,1cyclictest819416-21apt-get22:45:115
694223991919,0cyclictest0-21swapper/421:25:134
694223991919,0cyclictest0-21swapper/420:35:144
694223991919,0cyclictest0-21swapper/419:10:114
694223991919,0cyclictest0-21swapper/400:30:134
694223991919,0cyclictest0-21swapper/400:05:134
694223991917,1cyclictest0-21swapper/400:00:124
694219991918,1cyclictest790577-21apt-get21:55:133
694219991918,0cyclictest0-21swapper/321:10:133
694219991917,2cyclictest807305-21munin-run22:25:003
694219991917,1cyclictest0-21swapper/319:30:013
694217991919,0cyclictest0-21swapper/223:25:122
694217991919,0cyclictest0-21swapper/221:35:122
69421799190,0cyclictest0-21swapper/220:20:142
694214991919,0cyclictest0-21swapper/123:20:131
694214991919,0cyclictest0-21swapper/119:20:091
694212991919,0cyclictest0-21swapper/023:45:110
694212991919,0cyclictest0-21swapper/023:40:100
694212991919,0cyclictest0-21swapper/022:45:120
694212991919,0cyclictest0-21swapper/021:45:110
694212991919,0cyclictest0-21swapper/020:25:020
694212991919,0cyclictest0-21swapper/020:10:100
694212991919,0cyclictest0-21swapper/000:30:110
694212991917,1cyclictest842803-21apt-get23:25:130
694230991818,0cyclictest0-21swapper/722:35:117
694230991818,0cyclictest0-21swapper/722:05:127
694230991815,3cyclictest723796-21apt-get20:00:117
694228991818,0cyclictest799147-21apt-get22:10:116
694228991818,0cyclictest0-21swapper/619:25:136
694228991818,0cyclictest0-21swapper/600:30:126
694228991817,1cyclictest833268-21apt-get23:10:006
694225991818,0cyclictest0-21swapper/519:30:125
694225991817,0cyclictest0-21swapper/521:05:025
694223991818,0cyclictest0-21swapper/422:35:014
694223991818,0cyclictest0-21swapper/422:20:004
694223991818,0cyclictest0-21swapper/400:10:124
694223991816,1cyclictest770597-21apt-get21:20:124
694223991816,1cyclictest715223-21apt-get19:45:104
694219991818,0cyclictest0-21swapper/321:00:113
69421999180,2cyclictest0-21swapper/319:20:103
694217991818,0cyclictest0-21swapper/222:15:102
694217991818,0cyclictest0-21swapper/220:25:022
694217991818,0cyclictest0-21swapper/219:50:102
694217991818,0cyclictest0-21swapper/219:15:122
694217991818,0cyclictest0-21swapper/200:35:132
694217991818,0cyclictest0-21swapper/200:35:132
694217991818,0cyclictest0-21swapper/200:10:122
694217991817,1cyclictest0-21swapper/221:25:122
694217991817,1cyclictest0-21swapper/221:20:122
694217991817,1cyclictest0-21swapper/220:30:122
694214991818,0cyclictest0-21swapper/121:50:121
694214991818,0cyclictest0-21swapper/121:20:131
694214991818,0cyclictest0-21swapper/121:05:011
694214991818,0cyclictest0-21swapper/120:15:011
694214991818,0cyclictest0-21swapper/119:35:111
694214991817,1cyclictest0-21swapper/100:30:121
694212991818,0cyclictest0-21swapper/023:20:010
694212991818,0cyclictest0-21swapper/022:40:110
694212991818,0cyclictest0-21swapper/022:05:110
694212991818,0cyclictest0-21swapper/020:45:110
694212991818,0cyclictest0-21swapper/000:05:130
694212991816,1cyclictest0-21swapper/021:05:010
69421299180,0cyclictest0-21swapper/023:35:100
694230991717,0cyclictest694496-21apt-get19:10:127
694230991717,0cyclictest0-21swapper/721:15:117
694230991714,0cyclictest0-21swapper/723:40:117
69423099170,15cyclictest0-21swapper/700:03:327
694228991717,0cyclictest0-21swapper/623:05:126
694228991717,0cyclictest0-21swapper/620:00:116
694228991717,0cyclictest0-21swapper/600:10:126
694228991716,0cyclictest0-21swapper/622:00:116
694228991715,2cyclictest850959-21sleep23:39:596
694228991713,3cyclictest784450-21dump-pmu-power21:45:006
694225991717,0cyclictest0-21swapper/523:15:115
694225991717,0cyclictest0-21swapper/521:20:135
694225991717,0cyclictest0-21swapper/520:20:135
694225991717,0cyclictest0-21swapper/519:55:125
694225991717,0cyclictest0-21swapper/519:55:125
694225991716,1cyclictest0-21swapper/522:00:115
694225991715,1cyclictest885263-21perf00:40:005
694225991715,1cyclictest885263-21perf00:40:005
694225991715,1cyclictest0-21swapper/523:05:125
694223991717,0cyclictest0-21swapper/422:45:134
694223991717,0cyclictest0-21swapper/421:30:124
694223991717,0cyclictest0-21swapper/420:30:134
694223991717,0cyclictest0-21swapper/400:35:124
694223991717,0cyclictest0-21swapper/400:35:124
694223991716,0cyclictest0-21swapper/422:20:114
694223991715,1cyclictest0-21swapper/421:05:124
694223991714,2cyclictest735380-21wc20:20:014
69422399170,1cyclictest830844-21apt-get23:05:124
69422399170,16cyclictest0-21swapper/422:05:104
694219991717,0cyclictest0-21swapper/323:30:113
694219991717,0cyclictest0-21swapper/321:45:113
694219991717,0cyclictest0-21swapper/320:55:003
694219991716,1cyclictest854233-21apt-get23:45:103
694219991716,1cyclictest0-21swapper/323:24:593
694219991716,0cyclictest0-21swapper/322:50:123
694217991717,0cyclictest0-21swapper/221:30:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional