You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 03:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Jun 17, 2026 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9500992921,7cyclictest26965-21grep00:35:002
9500992819,4cyclictest0-21swapper/221:12:562
950099280,1cyclictest2710-21diskmemload22:00:352
950099280,1cyclictest17658-21vmstat23:55:062
950099280,0cyclictest2710-21diskmemload23:31:282
950099270,2cyclictest18752-21ssh00:27:242
9500992621,4cyclictest27522-21apt-get22:34:552
950099260,25cyclictest0-21swapper/223:53:422
950199250,24cyclictest2710-21diskmemload23:27:123
950199250,24cyclictest2710-21diskmemload22:26:483
950199250,24cyclictest2710-21diskmemload22:26:483
9500992520,4cyclictest13420-21ssh00:22:202
9500992520,4cyclictest0-21swapper/223:16:252
9500992519,5cyclictest3156-21ssh22:10:232
9500992519,5cyclictest14544-21apt-get20:29:542
950099250,25cyclictest0-21swapper/200:19:332
950099250,24cyclictest2710-21diskmemload23:43:462
950099250,24cyclictest0-21swapper/223:02:082
950099250,24cyclictest0-21swapper/222:05:432
950099250,24cyclictest0-21swapper/200:01:102
950099250,0cyclictest2710-21diskmemload22:36:202
950099250,0cyclictest24147-21apt-get20:49:552
949999250,24cyclictest0-21swapper/122:00:471
949999250,1cyclictest0-21swapper/122:50:111
9498992523,1cyclictest0-21swapper/022:27:440
9498992523,1cyclictest0-21swapper/022:27:440
949899250,24cyclictest2710-21diskmemload23:04:120
949899250,24cyclictest2710-21diskmemload22:21:470
949899250,24cyclictest0-21swapper/023:33:220
949899250,1cyclictest2710-21diskmemload00:13:480
949899250,1cyclictest24222-21perf19:40:010
949899250,0cyclictest0-21swapper/021:18:580
9501992423,1cyclictest0-21swapper/322:10:123
950199240,24cyclictest28598-21ssh00:05:283
950199240,23cyclictest0-21swapper/300:32:453
9500992423,0cyclictest0-21swapper/223:24:552
9500992420,3cyclictest0-21swapper/221:30:172
9500992419,5cyclictest0-21swapper/220:25:012
9500992419,4cyclictest3266-21rm00:13:022
9500992419,4cyclictest21272-21ssh21:27:302
950099240,24cyclictest0-21swapper/223:36:032
950099240,23cyclictest0-21swapper/222:47:142
950099240,0cyclictest0-21swapper/223:25:162
950099240,0cyclictest0-21swapper/222:43:452
950099240,0cyclictest0-21swapper/200:09:062
9499992424,0cyclictest0-21swapper/122:12:451
9499992424,0cyclictest0-21swapper/100:26:411
9499992420,1cyclictest0-21swapper/123:29:541
949999240,23cyclictest2710-21diskmemload23:49:241
949999240,23cyclictest2710-21diskmemload23:19:391
949999240,23cyclictest0-21swapper/121:51:071
949999240,23cyclictest0-21swapper/100:31:531
949999240,1cyclictest0-21swapper/123:57:581
949999240,0cyclictest2710-21diskmemload22:22:141
949999240,0cyclictest0-21swapper/122:59:521
949999240,0cyclictest0-21swapper/122:43:501
9498992424,0cyclictest2710-21diskmemload21:50:540
9498992423,1cyclictest36942sleep023:42:530
9498992422,2cyclictest16018-21ssh22:54:250
9498992422,1cyclictest18601-21cron21:25:000
949899240,23cyclictest2710-21diskmemload21:10:590
949899240,23cyclictest0-21swapper/023:18:360
949899240,23cyclictest0-21swapper/022:33:450
949899240,0cyclictest27533-21ssh22:04:180
949899240,0cyclictest0-21swapper/022:42:180
9501992323,0cyclictest0-21swapper/323:31:103
9501992323,0cyclictest0-21swapper/322:55:113
9501992323,0cyclictest0-21swapper/322:30:313
950199232,21cyclictest9915-21ssh21:16:243
9501992321,1cyclictest32530-21apt-get19:59:543
9501992321,1cyclictest0-21swapper/323:58:133
9501992321,1cyclictest0-21swapper/323:47:003
9501992321,1cyclictest0-21swapper/323:39:483
950199230,2cyclictest8506-21ssh00:17:553
950199230,2cyclictest14550-21ssh00:24:043
950199230,23cyclictest0-21swapper/323:18:583
950199230,23cyclictest0-21swapper/322:35:303
950199230,23cyclictest0-21swapper/321:48:543
950199230,22cyclictest6032-21ssh21:13:373
950199230,22cyclictest3249-21sh21:40:053
950199230,22cyclictest29827-21ssh23:05:283
950199230,22cyclictest28872-21perf22:05:003
950199230,22cyclictest22905-21unixbench-2d00:00:033
950199230,22cyclictest17153-21ssh21:54:543
950199230,22cyclictest10425-21ssh22:49:043
950199230,1cyclictest2710-21diskmemload21:34:593
950199230,0cyclictest2710-21diskmemload23:52:233
950199230,0cyclictest2710-21diskmemload21:36:053
950199230,0cyclictest25802-21ssh23:02:273
9500992323,0cyclictest2710-21diskmemload21:18:002
9500992321,1cyclictest2576-21mailstats21:40:012
9500992320,3cyclictest0-21swapper/222:59:312
9500992320,3cyclictest0-21swapper/222:22:312
9500992319,3cyclictest2710-21diskmemload21:40:382
950099231,1cyclictest24248-21sendmail-msp19:40:012
950099230,2cyclictest29575-21rm23:05:072
950099230,23cyclictest0-21swapper/222:25:322
950099230,23cyclictest0-21swapper/222:25:322
950099230,23cyclictest0-21swapper/200:35:062
950099230,22cyclictest2710-21diskmemload22:16:402
950099230,22cyclictest16005-21rm22:54:242
950099230,19cyclictest0-21swapper/223:46:522
950099230,0cyclictest0-21swapper/223:13:272
950099230,0cyclictest0-21swapper/223:13:272
950099230,0cyclictest0-21swapper/221:56:102
950099230,0cyclictest0-21swapper/221:20:432
9499992323,0cyclictest0-21swapper/123:40:221
9499992323,0cyclictest0-21swapper/123:14:171
9499992323,0cyclictest0-21swapper/123:14:171
9499992323,0cyclictest0-21swapper/122:32:551
9499992323,0cyclictest0-21swapper/121:26:501
9499992323,0cyclictest0-21swapper/121:13:111
9499992323,0cyclictest0-21swapper/120:04:551
9499992321,1cyclictest29576-21ssh00:06:591
9499992321,1cyclictest0-21swapper/123:05:441
9499992321,1cyclictest0-21swapper/121:55:291
9499992321,1cyclictest0-21swapper/121:34:281
9499992321,1cyclictest0-21swapper/119:40:011
949999230,2cyclictest12052-21sh00:20:191
949999230,23cyclictest0-21swapper/121:18:561
949999230,22cyclictest7013-21ssh00:15:431
949999230,22cyclictest30904-21sh23:38:101
949999230,22cyclictest30444-21wc21:00:011
949999230,22cyclictest26414-21open_files19:45:001
949999230,22cyclictest0-21swapper/123:01:451
949999230,0cyclictest0-21swapper/122:47:191
949999230,0cyclictest0-21swapper/121:22:121
949999230,0cyclictest0-21swapper/100:00:261
9498992323,0cyclictest2710-21diskmemload00:35:390
9498992323,0cyclictest0-21swapper/023:11:570
9498992323,0cyclictest0-21swapper/023:11:570
9498992323,0cyclictest0-21swapper/022:09:260
9498992323,0cyclictest0-21swapper/000:33:100
9498992321,1cyclictest12184-21ssh00:20:300
9498992320,2cyclictest13754-21ssh23:21:120
949899230,2cyclictest0-21swapper/000:29:170
949899230,23cyclictest0-21swapper/021:32:070
949899230,22cyclictest29745-21ssh00:07:140
949899230,22cyclictest2710-21diskmemload22:15:440
949899230,22cyclictest0-21swapper/023:05:330
949899230,1cyclictest62550irq/127-eno123:52:190
949899230,0cyclictest2710-21diskmemload21:39:400
949899230,0cyclictest0-21swapper/023:27:490
949899230,0cyclictest0-21swapper/022:49:260
949899230,0cyclictest0-21swapper/022:14:170
949899230,0cyclictest0-21swapper/021:59:470
9501992220,1cyclictest26545-21apt-get20:54:543
9501992220,1cyclictest17986-21rm00:26:103
9501992220,1cyclictest1736-21ssh00:10:473
9501992220,1cyclictest0-21swapper/321:20:293
950199220,22cyclictest2710-21diskmemload23:40:063
950199220,22cyclictest0-21swapper/321:57:203
950199220,21cyclictest8305-21ssh22:15:123
950199220,21cyclictest30139-21apt-get19:54:543
950199220,21cyclictest27685-21apt-get19:49:533
950199220,21cyclictest2710-21diskmemload22:51:253
950199220,21cyclictest2710-21diskmemload22:20:273
950199220,21cyclictest2710-21diskmemload21:25:173
950199220,21cyclictest21815-21awk19:35:013
950199220,21cyclictest0-21swapper/322:43:203
950199220,21cyclictest0-21swapper/300:35:233
950199220,1cyclictest13126-21ssh23:20:123
9500992220,1cyclictest1254-21sh20:00:002
9500992219,2cyclictest14075-21ssh21:50:152
950099220,21cyclictest0-21swapper/220:04:562
950099220,1cyclictest12325-21cut21:49:562
950099220,0cyclictest0-21swapper/219:54:542
9499992222,0cyclictest0-21swapper/123:53:511
9499992222,0cyclictest0-21swapper/122:15:521
9499992221,1cyclictest0-21swapper/121:41:301
9499992220,1cyclictest13977-21sh23:21:311
9499992220,1cyclictest0-21swapper/121:35:551
9499992220,1cyclictest0-21swapper/100:35:211
949999220,21cyclictest30042-21ssh22:35:431
949999220,21cyclictest2710-21diskmemload23:30:031
949999220,21cyclictest12148-21apt-get20:24:541
949999220,21cyclictest0-21swapper/122:27:421
949999220,21cyclictest0-21swapper/122:27:421
949999220,21cyclictest0-21swapper/121:45:111
949999220,21cyclictest0-21swapper/120:39:551
949999220,0cyclictest0-21swapper/120:29:541
9498992222,0cyclictest0-21swapper/000:19:050
9498992220,2cyclictest31734-21ssh23:39:210
9498992220,1cyclictest29935-21runrttasks22:35:350
9498992220,1cyclictest0-21swapper/022:55:020
949899220,21cyclictest0-21swapper/019:24:550
949899220,1cyclictest2710-21diskmemload21:40:110
9501992120,1cyclictest27993-21/usr/sbin/munin22:05:063
9501992119,1cyclictest15636-21sh20:30:003
950199210,20cyclictest19340-21apt-get20:39:553
9500992120,1cyclictest15694-21apt-get19:24:552
9500992119,1cyclictest0-21swapper/220:34:542
950099210,20cyclictest0-21swapper/221:04:542
950099210,1cyclictest10826-21apt-get19:14:532
9499992121,0cyclictest0-21swapper/121:04:541
9499992119,1cyclictest0-21swapper/120:44:531
949999210,0cyclictest0-21swapper/121:09:531
9498992119,1cyclictest24147-21apt-get20:49:540
949899210,21cyclictest0-21swapper/019:59:540
949899210,1cyclictest9730-21apt-get20:19:530
9501992020,0cyclictest13272-21apt-get19:19:513
9501992020,0cyclictest0-21swapper/320:09:553
9501992020,0cyclictest0-21swapper/320:09:553
9501992018,1cyclictest619-21polkitd20:15:013
950199200,20cyclictest0-21swapper/319:14:543
9500992019,1cyclictest1378-21apt-get21:09:532
9500992019,0cyclictest0-21swapper/220:44:532
9499992020,0cyclictest0-21swapper/119:24:551
9499992020,0cyclictest0-21swapper/119:19:511
9499992020,0cyclictest0-21swapper/119:14:541
9499992019,0cyclictest0-21swapper/119:54:541
9499992018,1cyclictest606-21dbus-daemon20:00:001
949999200,0cyclictest0-21swapper/120:34:531
949999200,0cyclictest0-21swapper/119:34:531
9498992020,0cyclictest0-21swapper/020:54:550
9498992020,0cyclictest0-21swapper/020:29:540
9498992020,0cyclictest0-21swapper/019:29:530
9498992020,0cyclictest0-21swapper/019:19:510
9498992018,1cyclictest2712-21sh21:10:010
949899200,0cyclictest0-21swapper/020:14:530
949899200,0cyclictest0-21swapper/020:09:550
949899200,0cyclictest0-21swapper/020:09:550
9501991918,1cyclictest28935-21apt-get20:59:513
9500991918,0cyclictest0-21swapper/220:19:532
9500991917,2cyclictest7325-21apt-get20:14:532
9499991919,0cyclictest0-21swapper/120:49:541
9499991919,0cyclictest0-21swapper/120:14:531
9499991919,0cyclictest0-21swapper/120:09:551
9499991919,0cyclictest0-21swapper/120:09:551
9501991816,1cyclictest13454-21turbostat.cron20:25:013
9500991818,0cyclictest0-21swapper/220:54:552
9500991818,0cyclictest0-21swapper/220:39:552
9500991818,0cyclictest0-21swapper/219:19:512
9499991818,0cyclictest0-21swapper/119:29:541
9498991817,1cyclictest10826-21apt-get19:14:540
9501991717,0cyclictest0-21swapper/320:49:553
9501991717,0cyclictest0-21swapper/320:04:553
9501991717,0cyclictest0-21swapper/319:29:543
9500991716,1cyclictest4932-21apt-get20:09:552
9500991716,1cyclictest4932-21apt-get20:09:552
9498991717,0cyclictest0-21swapper/020:04:550
9501991616,0cyclictest25294-21apt-get19:44:543
9501991616,0cyclictest21754-21apt-get20:44:533
9501991616,0cyclictest0-21swapper/321:09:543
9501991616,0cyclictest0-21swapper/320:34:543
950199160,15cyclictest32038-21grep21:04:573
9500991614,1cyclictest21286-21irqstats19:34:572
9499991616,0cyclictest0-21swapper/119:49:531
9498991616,0cyclictest0-21swapper/021:04:540
9498991616,0cyclictest0-21swapper/020:59:520
9498991616,0cyclictest0-21swapper/020:44:530
9501991513,1cyclictest16778-21perf19:25:013
9499991515,0cyclictest0-21swapper/120:54:541
9498991515,0cyclictest0-21swapper/019:44:540
9498991512,2cyclictest13443-21cron20:25:010
9501991414,0cyclictest0-21swapper/320:15:243
9501991414,0cyclictest0-21swapper/319:35:293
950099140,14cyclictest0-21swapper/219:40:322
950099140,14cyclictest0-21swapper/219:25:142
950099140,0cyclictest0-21swapper/220:55:252
950099140,0cyclictest0-21swapper/219:45:092
9498991414,0cyclictest0-21swapper/020:35:260
9498991414,0cyclictest0-21swapper/019:45:340
949899140,14cyclictest0-21swapper/019:52:090
949899140,0cyclictest0-21swapper/019:30:470
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional