You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 21:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Mon Mar 23, 2026 12:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2213099270,26cyclictest0-21swapper/310:21:533
2213099270,22cyclictest26556-21tr11:27:463
2213099270,0cyclictest15487-21diskmemload11:24:223
2213099260,26cyclictest0-21swapper/309:58:423
2213099260,1cyclictest0-21swapper/311:14:013
22120992622,1cyclictest0-21swapper/011:52:460
22130992522,3cyclictest0-21swapper/312:37:023
2213099250,25cyclictest0-21swapper/309:47:463
2213099250,25cyclictest0-21swapper/309:24:203
2213099250,24cyclictest15487-21diskmemload12:32:253
2213099250,24cyclictest0-21swapper/311:16:093
2213099250,24cyclictest0-21swapper/309:39:283
2213099250,1cyclictest18777-21ssh10:16:423
2213099250,1cyclictest18777-21ssh10:16:423
2213099250,1cyclictest0-21swapper/310:06:273
2213099250,0cyclictest0-21swapper/310:40:423
2212399250,24cyclictest15487-21diskmemload11:07:291
2212399250,24cyclictest0-21swapper/111:17:131
2212099252,22cyclictest62550irq/127-eno110:10:020
22130992420,4cyclictest0-21swapper/307:20:013
22130992420,3cyclictest7131-21ssh12:12:203
2213099240,24cyclictest0-21swapper/309:29:123
2213099240,23cyclictest27896-21ssh12:00:073
2213099240,23cyclictest15487-21diskmemload12:17:053
2213099240,23cyclictest0-21swapper/311:56:583
2213099240,23cyclictest0-21swapper/311:03:223
2213099240,23cyclictest0-21swapper/309:15:213
2213099240,21cyclictest0-21swapper/310:54:063
2213099240,0cyclictest0-21swapper/311:54:003
2213099240,0cyclictest0-21swapper/309:34:333
2212899242,22cyclictest4694-21ssh09:31:322
22128992422,1cyclictest271rcuc/209:25:012
22128992420,0cyclictest0-21swapper/210:39:502
2212899240,1cyclictest16604-21ssh11:48:422
2212399240,2cyclictest19996-21ssh09:45:531
2212399240,24cyclictest0-21swapper/111:24:501
2212399240,24cyclictest0-21swapper/109:16:391
2212399240,23cyclictest3987-21ssh10:02:351
22120992423,1cyclictest62550irq/127-eno111:08:580
2212099241,0cyclictest15487-21diskmemload10:53:530
2212099240,24cyclictest0-21swapper/011:55:440
2212099240,24cyclictest0-21swapper/010:41:440
2212099240,23cyclictest25737-21sendmail09:20:000
2212099240,23cyclictest15487-21diskmemload12:39:290
2212099240,1cyclictest0-21swapper/012:14:350
2212099240,0cyclictest5859-21perf08:50:010
2212099240,0cyclictest0-21swapper/009:57:360
22130992323,0cyclictest0-21swapper/310:12:563
22130992320,3cyclictest0-21swapper/312:29:163
22130992320,3cyclictest0-21swapper/310:55:213
22130992320,3cyclictest0-21swapper/310:26:243
22130992319,3cyclictest15487-21diskmemload11:30:563
2213099230,23cyclictest15487-21diskmemload10:33:353
2213099230,23cyclictest0-21swapper/311:41:103
2213099230,22cyclictest15487-21diskmemload12:21:513
2213099230,22cyclictest15487-21diskmemload10:46:393
2213099230,22cyclictest1516-21apt-get08:42:453
2213099230,22cyclictest1516-21apt-get08:42:453
2213099230,20cyclictest15487-21diskmemload09:10:353
2213099230,0cyclictest0-21swapper/312:05:043
2213099230,0cyclictest0-21swapper/311:06:233
2213099230,0cyclictest0-21swapper/310:38:193
22128992323,0cyclictest17115-21apt-get08:07:442
22128992323,0cyclictest15487-21diskmemload12:19:022
22128992323,0cyclictest15487-21diskmemload11:08:212
22128992323,0cyclictest15487-21diskmemload10:03:002
22128992323,0cyclictest0-21swapper/211:40:222
22128992323,0cyclictest0-21swapper/209:35:372
22128992322,1cyclictest2093-21rm10:00:002
22128992321,1cyclictest0-21swapper/211:37:552
22128992321,1cyclictest0-21swapper/210:13:392
22128992320,1cyclictest25751-21ssh09:52:002
22128992319,4cyclictest0-21swapper/209:26:272
22128992319,1cyclictest0-21swapper/210:42:462
2212899230,23cyclictest0-21swapper/211:28:522
2212899230,23cyclictest0-21swapper/210:59:202
2212899230,22cyclictest9549-21sh11:10:312
2212899230,22cyclictest22237-21ssh09:17:172
2212899230,22cyclictest17884-21ssh11:50:222
2212899230,22cyclictest10460-21idleruntime-cro12:15:002
2212899230,20cyclictest0-21swapper/212:22:152
2212899230,1cyclictest23137-21ssh09:48:052
2212899230,0cyclictest15487-21diskmemload12:39:462
2212899230,0cyclictest0-21swapper/211:57:282
22123992323,0cyclictest15487-21diskmemload10:06:261
22123992323,0cyclictest0-21swapper/112:11:461
22123992323,0cyclictest0-21swapper/111:39:051
22123992323,0cyclictest0-21swapper/111:25:471
22123992321,1cyclictest2156-21perf10:00:001
22123992321,1cyclictest19437-21ssh09:13:131
22123992321,1cyclictest0-21swapper/112:24:511
22123992320,2cyclictest3963-21ssh09:30:161
22123992320,2cyclictest11129-21rm12:15:401
2212399230,2cyclictest10638-21idleruntime-cro09:00:011
2212399230,23cyclictest15487-21diskmemload10:24:511
2212399230,23cyclictest0-21swapper/112:08:301
2212399230,23cyclictest0-21swapper/112:00:531
2212399230,23cyclictest0-21swapper/110:52:161
2212399230,23cyclictest0-21swapper/109:21:411
2212399230,22cyclictest17739-21ssh10:15:021
2212399230,22cyclictest17739-21ssh10:15:021
2212399230,22cyclictest15487-21diskmemload10:31:531
2212399230,22cyclictest15487-21diskmemload09:25:111
2212399230,22cyclictest0-21swapper/112:35:281
2212399230,22cyclictest0-21swapper/111:10:301
2212399230,1cyclictest0-21swapper/111:41:371
2212399230,0cyclictest15487-21diskmemload11:50:091
2212399230,0cyclictest15487-21diskmemload10:26:461
2212399230,0cyclictest0-21swapper/112:30:161
2212399230,0cyclictest0-21swapper/111:48:411
2212399230,0cyclictest0-21swapper/110:57:491
2212399230,0cyclictest0-21swapper/110:10:411
22120992323,0cyclictest15487-21diskmemload09:30:590
22120992323,0cyclictest15487-21diskmemload09:12:120
22120992323,0cyclictest0-21swapper/012:05:580
22120992323,0cyclictest0-21swapper/011:45:150
22120992323,0cyclictest0-21swapper/011:32:190
22120992322,1cyclictest0-21swapper/011:20:230
22120992321,1cyclictest15487-21diskmemload11:38:060
22120992321,1cyclictest15487-21diskmemload10:02:300
22120992321,1cyclictest0-21swapper/009:36:030
22120992320,2cyclictest0-21swapper/010:37:500
22120992320,2cyclictest0-21swapper/010:16:290
22120992320,2cyclictest0-21swapper/010:16:290
2212099230,2cyclictest31271-21cat12:02:530
2212099230,22cyclictest4692-21ssh10:33:540
2212099230,22cyclictest27979-21ssh10:25:090
2212099230,22cyclictest15487-21diskmemload12:32:140
2212099230,22cyclictest15487-21diskmemload10:20:570
2212099230,22cyclictest0-21swapper/010:46:200
2212099230,1cyclictest0-21swapper/011:42:410
2212099230,0cyclictest0-21swapper/009:22:040
22130992222,0cyclictest0-21swapper/310:00:293
22130992220,1cyclictest15168-21ssh09:41:123
22130992220,1cyclictest10667-21munin-run09:00:013
22130992218,3cyclictest0-21swapper/307:27:463
22130992216,5cyclictest24333-21apt-get08:22:443
2213099220,21cyclictest13524-21apt-get09:07:463
2213099220,21cyclictest0-21swapper/309:50:153
2213099220,21cyclictest0-21swapper/308:12:443
2213099220,1cyclictest0-21swapper/311:45:413
22128992222,0cyclictest26656-21ssh12:31:002
22128992222,0cyclictest0-21swapper/212:26:162
22128992222,0cyclictest0-21swapper/211:31:552
22128992220,2cyclictest15875-21ssh11:17:272
22128992220,1cyclictest14209-21perf08:00:012
2212899220,22cyclictest0-21swapper/210:50:432
2212899220,22cyclictest0-21swapper/210:45:162
2212899220,21cyclictest20602-21perf09:15:002
2212899220,21cyclictest1060-21ssh12:05:512
2212899220,21cyclictest0-21swapper/208:02:432
2212899220,1cyclictest4914-21ssh10:34:142
2212899220,1cyclictest20909-21ssh11:22:122
2212899220,1cyclictest0-21swapper/207:55:012
22123992222,0cyclictest15487-21diskmemload11:57:111
22123992222,0cyclictest0-21swapper/112:25:551
22123992221,1cyclictest14524-21ssh09:40:071
22123992221,1cyclictest0-21swapper/111:32:161
22123992220,1cyclictest31803-21ssh11:00:251
2212399220,22cyclictest0-21swapper/110:41:561
2212399220,21cyclictest15487-21diskmemload10:45:011
2212399220,1cyclictest14100-21ssh09:39:581
2212399220,1cyclictest0-21swapper/109:50:451
22120992222,0cyclictest0-21swapper/009:40:440
22120992220,1cyclictest31444-21cat11:00:010
22120992220,1cyclictest0-21swapper/011:10:040
22120992220,1cyclictest0-21swapper/009:25:150
2212099220,22cyclictest0-21swapper/009:54:000
2212099220,21cyclictest15487-21diskmemload12:15:010
2212099220,21cyclictest0-21swapper/011:25:590
2212099220,21cyclictest0-21swapper/010:09:370
2212099220,21cyclictest0-21swapper/009:45:430
2212099220,21cyclictest0-21swapper/008:22:430
2212099220,0cyclictest0-21swapper/011:00:180
22130992121,0cyclictest0-21swapper/307:42:443
22130992120,1cyclictest0-21swapper/307:12:433
22130992120,0cyclictest32561-21apt-get07:32:443
2213099210,2cyclictest32694-21pmu-power08:37:513
2213099210,20cyclictest6315-21apt-get08:52:453
2213099210,20cyclictest0-21swapper/308:02:433
2213099210,20cyclictest0-21swapper/307:52:443
2213099210,0cyclictest3920-21apt-get08:47:453
22128992121,0cyclictest19512-21apt-get08:12:442
22128992121,0cyclictest15487-21diskmemload10:20:542
22128992121,0cyclictest15487-21diskmemload09:40:212
2212899210,21cyclictest0-21swapper/212:00:022
2212899210,21cyclictest0-21swapper/211:00:232
2212899210,21cyclictest0-21swapper/210:25:162
2212899210,21cyclictest0-21swapper/210:15:102
2212899210,21cyclictest0-21swapper/210:15:102
22123992121,0cyclictest0-21swapper/108:42:451
22123992121,0cyclictest0-21swapper/108:42:451
22123992120,1cyclictest29125-21apt-get08:32:441
22123992119,1cyclictest0-21swapper/108:52:441
22123992119,1cyclictest0-21swapper/107:30:021
2212399210,20cyclictest0-21swapper/108:17:441
2212399210,0cyclictest0-21swapper/110:35:131
22120992120,1cyclictest14722-21apt-get08:02:430
22120992119,1cyclictest606-21dbus-daemon07:20:010
2212099210,20cyclictest15487-21diskmemload12:25:020
2212099210,0cyclictest0-21swapper/007:32:440
22130992020,0cyclictest11128-21apt-get09:02:443
22130992020,0cyclictest0-21swapper/308:27:453
22130992020,0cyclictest0-21swapper/307:47:443
22128992020,0cyclictest0-21swapper/207:32:432
2212899200,0cyclictest2546-21apt-get07:37:442
2212899200,0cyclictest24960-21apt-get07:17:452
22123992020,0cyclictest0-21swapper/108:12:441
22123992020,0cyclictest0-21swapper/107:37:441
2212399200,0cyclictest0-21swapper/107:57:451
22120992020,0cyclictest0-21swapper/008:37:440
22120992020,0cyclictest0-21swapper/008:32:440
2212099200,2cyclictest7015-21basename07:45:000
2212099200,0cyclictest0-21swapper/007:57:450
22130991919,0cyclictest27375-21apt-get07:22:443
2213099190,1cyclictest22469-21/usr/sbin/munin08:17:463
22128991919,0cyclictest0-21swapper/209:02:442
22128991919,0cyclictest0-21swapper/208:22:432
22128991919,0cyclictest0-21swapper/207:12:432
2212899190,18cyclictest0-21swapper/208:52:442
22123991919,0cyclictest29772-21apt-get07:27:451
22123991919,0cyclictest0-21swapper/108:27:451
22123991919,0cyclictest0-21swapper/107:52:451
22123991919,0cyclictest0-21swapper/107:17:451
22123991918,1cyclictest0-21swapper/109:02:441
22123991916,2cyclictest15503-21ls09:10:001
22120991919,0cyclictest0-21swapper/008:12:440
22120991919,0cyclictest0-21swapper/007:50:010
22120991917,1cyclictest28664-21turbostat08:30:000
2212099190,1cyclictest31689-21idleruntime-cro07:30:000
2213099180,2cyclictest0-21swapper/307:37:443
22128991818,0cyclictest0-21swapper/208:42:452
22128991818,0cyclictest0-21swapper/208:42:452
22128991816,1cyclictest1007-21sendmail08:40:012
22123991818,0cyclictest0-21swapper/108:47:451
22123991817,1cyclictest0-21swapper/108:22:441
22123991816,1cyclictest31521-21apt-get08:37:451
22120991818,0cyclictest0-21swapper/008:52:440
22120991816,1cyclictest10678-21basename09:00:010
22120991816,1cyclictest0-21swapper/007:52:450
22130991717,0cyclictest0-21swapper/308:07:443
22128991717,0cyclictest0-21swapper/207:50:012
22128991717,0cyclictest0-21swapper/207:27:452
22128991716,1cyclictest6970-21cron07:45:002
22128991714,2cyclictest622-21gdbus09:00:012
22123991717,0cyclictest0-21swapper/107:12:431
2212099170,16cyclictest19054-21sh08:10:010
2213099160,14cyclictest0-21swapper/307:56:213
22123991616,0cyclictest0-21swapper/108:07:441
22123991616,0cyclictest0-21swapper/108:02:431
22123991616,0cyclictest0-21swapper/107:42:441
22128991512,2cyclictest15489-21ssh09:10:002
22120991514,1cyclictest0-21swapper/009:02:440
2213099140,14cyclictest0-21swapper/308:30:073
2212899140,14cyclictest0-21swapper/208:25:252
2212899140,14cyclictest0-21swapper/207:20:332
2212899140,0cyclictest0-21swapper/208:46:382
2212899140,0cyclictest0-21swapper/208:30:182
2212099140,14cyclictest0-21swapper/008:16:380
2212099140,14cyclictest0-21swapper/007:35:040
2212099140,14cyclictest0-21swapper/007:20:280
2212099140,0cyclictest0-21swapper/009:05:300
2212099140,0cyclictest0-21swapper/008:40:130
2212099140,0cyclictest0-21swapper/008:40:130
2212099140,0cyclictest0-21swapper/007:10:560
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional