You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 03:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Mar 18, 2026 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31812992821,6cyclictest5872-21ssh00:27:241
31812992820,7cyclictest8286-21apt-get22:27:151
3181299280,27cyclictest1382-21rm00:22:411
3180899280,5cyclictest109132chrt21:27:160
3180899280,4cyclictest0-21swapper/022:48:020
3180899280,1cyclictest25444-21diskmemload22:57:430
3180899280,1cyclictest25444-21diskmemload21:17:560
3181299270,22cyclictest0-21swapper/100:15:131
3181299270,21cyclictest15852-21apt00:07:171
3180899270,26cyclictest27592-21ssh22:44:450
3180899270,26cyclictest0-21swapper/023:56:050
3180899270,26cyclictest0-21swapper/023:47:550
3180899270,26cyclictest0-21swapper/023:07:240
31812992623,2cyclictest18979-21ssh21:34:471
31812992622,4cyclictest25444-21diskmemload22:45:441
31812992621,4cyclictest0-21swapper/122:42:201
31812992619,6cyclictest0-21swapper/121:15:001
31812992619,1cyclictest5895-21idleruntime-cro22:55:001
3181299260,25cyclictest0-21swapper/122:21:411
3181299260,21cyclictest0-21swapper/123:18:171
3181299260,1cyclictest0-21swapper/123:36:411
31808992622,3cyclictest25444-21diskmemload22:14:410
3180899260,26cyclictest0-21swapper/023:28:320
3180899260,25cyclictest27977-21ssh23:16:360
3180899260,25cyclictest0-21swapper/022:30:340
3180899260,25cyclictest0-21swapper/021:44:220
3180899260,25cyclictest0-21swapper/021:35:120
3180899260,23cyclictest0-21swapper/021:57:050
3180899260,0cyclictest0-21swapper/000:12:580
3182299250,24cyclictest0-21swapper/323:53:593
31814992520,2cyclictest12860-21ssh22:31:252
3181499250,24cyclictest25444-21diskmemload22:03:212
3181499250,24cyclictest25444-21diskmemload00:12:292
31812992520,4cyclictest0-21swapper/121:26:011
31812992519,0cyclictest0-21swapper/121:47:171
3181299250,24cyclictest0-21swapper/123:12:231
3181299250,24cyclictest0-21swapper/123:02:181
3181299250,24cyclictest0-21swapper/122:55:571
3181299250,24cyclictest0-21swapper/119:15:011
3181299250,24cyclictest0-21swapper/100:12:081
3181299250,0cyclictest0-21swapper/122:38:291
31808992523,1cyclictest1208-21sh22:50:380
31808992520,4cyclictest21203-21taskset23:40:470
3180899250,4cyclictest0-21swapper/023:20:190
3180899250,4cyclictest0-21swapper/022:25:430
3180899250,24cyclictest25444-21diskmemload22:08:530
3180899250,24cyclictest0-21swapper/019:47:160
3180899250,24cyclictest0-21swapper/000:24:180
31822992423,1cyclictest30138-21apt-get22:17:173
31822992422,1cyclictest0-21swapper/321:51:593
31822992422,1cyclictest0-21swapper/321:13:143
3182299240,24cyclictest0-21swapper/322:50:393
3182299240,23cyclictest25444-21diskmemload21:41:513
3182299240,23cyclictest0-21swapper/322:25:023
3182299240,23cyclictest0-21swapper/300:26:173
3182299240,1cyclictest25444-21diskmemload23:02:323
31814992423,1cyclictest29967-21ssh23:48:422
31814992422,1cyclictest0-21swapper/221:39:562
3181499240,24cyclictest0-21swapper/223:34:292
3181499240,23cyclictest25444-21diskmemload22:41:242
3181499240,23cyclictest25444-21diskmemload21:56:592
3181499240,23cyclictest0-21swapper/221:17:552
3181499240,1cyclictest25444-21diskmemload22:50:272
31812992421,3cyclictest0-21swapper/121:50:511
31812992421,3cyclictest0-21swapper/100:00:591
31812992420,4cyclictest25444-21diskmemload22:30:061
31812992419,4cyclictest0-21swapper/121:35:071
31812992419,1cyclictest0-21swapper/100:30:361
31812992419,0cyclictest28118-21irqstats23:47:201
3181299240,24cyclictest0-21swapper/122:06:031
3181299240,24cyclictest0-21swapper/122:00:191
3181299240,23cyclictest0-21swapper/123:21:401
3181299240,23cyclictest0-21swapper/122:16:261
3181299240,0cyclictest26141-21apt-get21:42:161
3181299240,0cyclictest0-21swapper/123:50:091
3180899240,4cyclictest0-21swapper/023:12:180
3180899240,23cyclictest25444-21diskmemload22:22:010
3180899240,23cyclictest25444-21diskmemload21:20:420
3180899240,23cyclictest25444-21diskmemload00:39:350
3180899240,23cyclictest25444-21diskmemload00:31:500
3180899240,23cyclictest0-21swapper/022:02:300
3180899240,23cyclictest0-21swapper/021:45:270
3180899240,23cyclictest0-21swapper/000:04:210
3180899240,0cyclictest0-21swapper/023:31:530
31822992323,0cyclictest25444-21diskmemload23:28:503
31822992322,0cyclictest21438-21apt-get19:57:163
31822992321,1cyclictest0-21swapper/322:47:213
31822992321,1cyclictest0-21swapper/322:10:123
31822992321,1cyclictest0-21swapper/322:07:163
31822992321,1cyclictest0-21swapper/300:21:153
31822992321,1cyclictest0-21swapper/300:17:263
3182299230,23cyclictest0-21swapper/321:29:173
3182299230,22cyclictest4337-21sh21:20:513
3182299230,22cyclictest2634-21ssh22:21:413
3182299230,22cyclictest25444-21diskmemload23:30:023
3182299230,22cyclictest25444-21diskmemload22:00:133
3182299230,22cyclictest21303-21diskmemload23:40:563
3182299230,22cyclictest17769-21ssh22:35:193
3182299230,1cyclictest23149-21ssh22:40:333
3182299230,1cyclictest0-21swapper/321:59:353
3182299230,0cyclictest25444-21diskmemload21:36:053
3182299230,0cyclictest25444-21diskmemload00:12:143
3182299230,0cyclictest0-21swapper/300:31:313
3182299230,0cyclictest0-21swapper/300:04:043
31814992323,0cyclictest25444-21diskmemload00:00:322
31814992323,0cyclictest0-21swapper/223:20:272
31814992323,0cyclictest0-21swapper/223:16:182
31814992323,0cyclictest0-21swapper/222:12:172
31814992323,0cyclictest0-21swapper/200:31:062
31814992320,2cyclictest21671-21ssh23:41:392
3181499230,23cyclictest25444-21diskmemload22:27:532
3181499230,23cyclictest0-21swapper/222:49:292
3181499230,23cyclictest0-21swapper/222:15:512
3181499230,23cyclictest0-21swapper/221:51:142
3181499230,23cyclictest0-21swapper/221:47:292
3181499230,22cyclictest9668-21ssh22:57:492
3181499230,22cyclictest7725-21ssh21:23:242
3181499230,22cyclictest4786-21ssh22:22:272
3181499230,22cyclictest17861-21ssh22:35:282
3181499230,22cyclictest15495-21sh21:32:022
3181499230,1cyclictest313-21systemd-journal19:25:002
3181499230,0cyclictest0-21swapper/222:05:562
3181499230,0cyclictest0-21swapper/200:35:482
3181499230,0cyclictest0-21swapper/200:15:362
31812992323,0cyclictest0-21swapper/123:05:251
31812992323,0cyclictest0-21swapper/122:13:481
31812992323,0cyclictest0-21swapper/121:16:171
31812992321,1cyclictest0-21swapper/121:59:591
31812992320,2cyclictest28229-21perf20:10:011
31812992320,0cyclictest0-21swapper/123:30:191
31812992319,4cyclictest0-21swapper/123:58:081
3181299231,21cyclictest774-21runrttasks21:21:001
3181299230,22cyclictest25444-21diskmemload00:35:201
3181299230,22cyclictest24520-21sh23:43:171
31808992323,0cyclictest62550irq/127-eno123:35:210
31808992323,0cyclictest0-21swapper/022:37:250
31808992323,0cyclictest0-21swapper/022:16:020
31808992321,1cyclictest0-21swapper/019:35:000
31808992320,2cyclictest25444-21diskmemload23:00:060
31808992320,2cyclictest16212-21idleruntime-cro19:45:000
3180899230,1cyclictest21442-21taskset19:57:160
3180899230,1cyclictest0-21swapper/021:30:530
3180899230,0cyclictest25444-21diskmemload00:25:510
3180899230,0cyclictest25444-21diskmemload00:05:470
3180899230,0cyclictest0-21swapper/021:50:310
3180899230,0cyclictest0-21swapper/021:11:580
31822992222,0cyclictest9441-21apt-get19:32:163
31822992222,0cyclictest25444-21diskmemload21:16:393
31822992222,0cyclictest0-21swapper/322:31:123
31822992222,0cyclictest0-21swapper/321:45:363
31822992220,1cyclictest25446-21idleruntime-cro21:10:003
31822992219,2cyclictest23052-21idleruntime-cro21:05:003
3182299220,21cyclictest31438-21apt-get20:17:173
3182299220,21cyclictest25960-21ssh23:45:143
3182299220,21cyclictest22113-21ssh23:10:363
3182299220,21cyclictest20670-21cat21:00:013
3182299220,21cyclictest14844-21chrt00:37:113
3182299220,21cyclictest0-21swapper/321:31:503
3182299220,1cyclictest6525-21ssh22:55:453
3182299220,1cyclictest13484-21munin-run20:45:013
3182299220,1cyclictest0-21swapper/323:39:163
3182299220,0cyclictest0-21swapper/323:05:173
31814992222,0cyclictest0-21swapper/223:55:152
31814992220,1cyclictest8232-21cron20:35:012
3181499220,22cyclictest29083-21sh21:44:132
3181499220,22cyclictest0-21swapper/223:35:522
3181499220,21cyclictest7042-21apt-get19:27:162
3181499220,21cyclictest606-21dbus-daemon20:25:002
3181499220,21cyclictest0-21swapper/200:05:222
3181499220,1cyclictest26985-21ssh21:12:022
3181499220,1cyclictest12208-21rm23:01:202
3181499220,1cyclictest0-21swapper/223:26:292
3181499220,0cyclictest25444-21diskmemload23:07:012
3181499220,0cyclictest0-21swapper/223:53:272
3181499220,0cyclictest0-21swapper/223:10:072
31812992220,1cyclictest5504-21ssh23:25:431
3181299220,21cyclictest0-21swapper/120:42:161
3181299220,21cyclictest0-21swapper/120:32:141
3181299220,21cyclictest0-21swapper/119:42:161
3181299220,0cyclictest0-21swapper/119:32:161
31808992221,1cyclictest0-21swapper/019:52:170
31808992221,1cyclictest0-21swapper/019:52:170
3180899220,21cyclictest0-21swapper/020:42:160
3180899220,21cyclictest0-21swapper/019:37:150
3180899220,1cyclictest28203-21awk20:10:010
3180899220,1cyclictest0-21swapper/020:50:010
3182299210,20cyclictest14439-21ssh00:05:023
3182299210,20cyclictest14254-21apt-get19:42:163
3182299210,0cyclictest0-21swapper/323:20:193
3182299210,0cyclictest0-21swapper/323:15:013
31814992121,0cyclictest0-21swapper/220:57:172
3181499210,21cyclictest0-21swapper/200:25:492
3181499210,20cyclictest0-21swapper/220:12:152
3181499210,1cyclictest11835-21apt-get19:37:152
31812992121,0cyclictest0-21swapper/120:27:171
31812992119,1cyclictest9000-21dump-pmu-power19:30:001
3181299210,20cyclictest0-21swapper/119:57:161
3181299210,0cyclictest0-21swapper/120:10:021
31808992121,0cyclictest0-21swapper/020:37:160
31808992121,0cyclictest0-21swapper/020:10:030
31808992120,0cyclictest0-21swapper/021:02:170
3180899210,21cyclictest0-21swapper/020:52:180
3180899210,0cyclictest0-21swapper/020:32:140
31822992020,0cyclictest0-21swapper/319:37:153
3182299200,0cyclictest0-21swapper/320:22:173
31814992020,0cyclictest26250-21apt-get20:07:172
31814992020,0cyclictest23857-21apt-get20:02:172
31814992020,0cyclictest0-21swapper/219:12:162
31814992018,1cyclictest0-21swapper/220:00:012
3181499200,0cyclictest0-21swapper/220:47:172
31812992020,0cyclictest0-21swapper/120:17:171
31808992020,0cyclictest18687-21apt-get20:57:170
31808992020,0cyclictest0-21swapper/021:07:140
31808992020,0cyclictest0-21swapper/020:27:170
3180899200,20cyclictest0-21swapper/019:12:150
31822991918,0cyclictest0-21swapper/319:22:153
31814991919,0cyclictest0-21swapper/220:55:012
31814991919,0cyclictest0-21swapper/220:27:172
31814991919,0cyclictest0-21swapper/219:42:162
31814991917,1cyclictest19043-21apt-get19:52:172
31814991917,1cyclictest19043-21apt-get19:52:172
31812991917,1cyclictest21104-21apt-get21:02:161
3180899190,0cyclictest0-21swapper/020:02:190
31814991818,0cyclictest23496-21apt-get21:07:142
31812991818,0cyclictest0-21swapper/119:52:171
31812991818,0cyclictest0-21swapper/119:52:171
31812991817,1cyclictest8879-21apt-get20:35:021
3180899183,14cyclictest32096-21idleruntime20:17:200
31808991818,0cyclictest0-21swapper/020:22:170
31808991818,0cyclictest0-21swapper/019:27:150
31822991717,0cyclictest0-21swapper/320:35:023
31822991717,0cyclictest0-21swapper/319:47:163
31812991715,1cyclictest606-21dbus-daemon21:00:011
31812991715,1cyclictest3424-21sleep20:25:001
3181299170,1cyclictest313-21systemd-journal19:25:001
31822991616,0cyclictest0-21swapper/319:15:013
31822991615,1cyclictest28217-21apt-get20:10:013
31822991615,0cyclictest0-21swapper/319:17:173
3182299160,15cyclictest6290-21apt-get20:32:143
3182299160,15cyclictest0-21swapper/320:12:203
31814991616,0cyclictest11502-21apt-get20:42:162
31814991615,1cyclictest8258-21apt-get20:35:022
3181299160,15cyclictest233752chrt21:06:031
3180899160,16cyclictest0-21swapper/019:21:530
3182299150,11cyclictest238242sleep320:02:173
31814991515,0cyclictest0-21swapper/221:02:162
31814991513,1cyclictest11420-21awk19:35:002
31812991515,0cyclictest0-21swapper/119:47:161
31812991514,0cyclictest0-21swapper/119:17:161
3180899152,12cyclictest2178-21apt-get19:17:160
3182299140,14cyclictest0-21swapper/320:45:013
3182299140,14cyclictest0-21swapper/320:25:223
3182299140,0cyclictest0-21swapper/320:51:273
3182299140,0cyclictest0-21swapper/319:50:493
3182299140,0cyclictest0-21swapper/319:50:493
3182299140,0cyclictest0-21swapper/319:25:133
3181499140,14cyclictest0-21swapper/220:18:542
3181499140,0cyclictest0-21swapper/219:16:242
3181299140,0cyclictest0-21swapper/120:50:231
3181299140,0cyclictest0-21swapper/120:45:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional