You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 00:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Sun May 24, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
422199272,24cyclictest30360-21diskmemload09:10:553
421399260,2cyclictest590-21ssh11:37:151
4221992522,2cyclictest606-21dbus-daemon08:00:003
422199250,2cyclictest7463-21sh12:40:013
422199250,24cyclictest0-21swapper/311:43:453
422199250,1cyclictest0-21swapper/309:25:013
421399250,1cyclictest940-21ssh10:10:271
4208992522,2cyclictest11412-21sh10:19:410
420899250,2cyclictest11801-21sh11:46:270
420899250,24cyclictest30360-21diskmemload09:58:240
420899250,24cyclictest0-21swapper/011:16:120
4221992422,2cyclictest22052-21sh10:28:593
422199240,23cyclictest30360-21diskmemload11:28:353
422199240,23cyclictest30360-21diskmemload10:39:213
422199240,23cyclictest0-21swapper/311:31:143
422199240,1cyclictest783-21snmpd10:58:253
4215992424,0cyclictest30360-21diskmemload10:59:022
4215992423,0cyclictest0-21swapper/209:22:572
421599240,1cyclictest30784-21ssh09:39:012
421599240,0cyclictest0-21swapper/210:34:502
4213992424,0cyclictest0-21swapper/110:20:311
421399240,23cyclictest4805-21ssh11:11:571
421399240,23cyclictest30360-21diskmemload11:27:581
421399240,23cyclictest0-21swapper/111:51:581
421399240,23cyclictest0-21swapper/111:46:591
421399240,1cyclictest7100-21ssh09:47:481
4208992424,0cyclictest0-21swapper/011:41:030
420899242,21cyclictest62550irq/127-eno111:26:240
420899241,22cyclictest17676-21sh11:51:490
420899240,2cyclictest2171-21rm11:09:150
420899240,23cyclictest30360-21diskmemload12:36:050
420899240,23cyclictest30360-21diskmemload10:14:210
420899240,23cyclictest0-21swapper/010:27:420
420899240,23cyclictest0-21swapper/009:45:240
420899240,1cyclictest846-21ssh10:38:520
420899240,1cyclictest31676-21tune2fs12:32:590
420899240,1cyclictest0-21swapper/010:05:100
420899240,0cyclictest30360-21diskmemload11:20:410
4221992323,0cyclictest0-21swapper/310:08:133
4221992323,0cyclictest0-21swapper/309:55:563
4221992323,0cyclictest0-21swapper/309:42:563
4221992322,0cyclictest30360-21diskmemload12:16:513
4221992322,0cyclictest0-21swapper/311:03:053
4221992321,2cyclictest13221-21ssh10:21:513
4221992321,1cyclictest0-21swapper/312:14:543
4221992321,1cyclictest0-21swapper/312:07:453
4221992321,1cyclictest0-21swapper/309:47:583
4221992321,1cyclictest0-21swapper/309:17:103
422199230,23cyclictest0-21swapper/310:47:363
422199230,22cyclictest30735-21apt-get08:05:023
422199230,22cyclictest27695-21sh12:00:163
422199230,22cyclictest0-21swapper/311:55:063
422199230,22cyclictest0-21swapper/310:31:253
422199230,1cyclictest0-21swapper/310:12:543
422199230,0cyclictest0-21swapper/311:15:023
422199230,0cyclictest0-21swapper/311:09:573
422199230,0cyclictest0-21swapper/310:42:083
422199230,0cyclictest0-21swapper/309:31:533
4215992323,0cyclictest30360-21diskmemload11:59:212
4215992323,0cyclictest0-21swapper/212:11:442
4215992323,0cyclictest0-21swapper/211:51:472
4215992323,0cyclictest0-21swapper/211:35:022
4215992323,0cyclictest0-21swapper/211:16:462
4215992323,0cyclictest0-21swapper/210:47:402
4215992323,0cyclictest0-21swapper/210:25:232
4215992323,0cyclictest0-21swapper/209:50:402
4215992322,1cyclictest31904-21ssh10:08:472
4215992320,0cyclictest0-21swapper/209:41:082
4215992318,1cyclictest13813-21ssh10:22:352
421599230,2cyclictest12053-21ssh11:46:552
421599230,23cyclictest30360-21diskmemload10:38:412
421599230,23cyclictest0-21swapper/211:11:012
421599230,23cyclictest0-21swapper/210:01:092
421599230,23cyclictest0-21swapper/209:59:562
421599230,22cyclictest6499-21ssh10:43:592
421599230,22cyclictest621-21ssh12:05:022
421599230,22cyclictest28942-21ssh12:01:582
421599230,22cyclictest23377-21latency_hist12:25:012
421599230,22cyclictest11606-21apt-get12:15:022
421599230,0cyclictest0-21swapper/211:02:052
421599230,0cyclictest0-21swapper/210:19:052
421599230,0cyclictest0-21swapper/209:47:562
421599230,0cyclictest0-21swapper/208:32:572
4213992323,0cyclictest0-21swapper/111:23:551
4213992323,0cyclictest0-21swapper/111:18:261
4213992323,0cyclictest0-21swapper/110:52:481
4213992323,0cyclictest0-21swapper/110:36:441
4213992323,0cyclictest0-21swapper/109:50:141
4213992323,0cyclictest0-21swapper/109:32:341
4213992321,1cyclictest30333-21ssh11:05:451
421399230,23cyclictest0-21swapper/112:07:111
421399230,23cyclictest0-21swapper/110:34:181
421399230,23cyclictest0-21swapper/109:39:111
421399230,23cyclictest0-21swapper/109:16:111
421399230,22cyclictest22713-21ssh10:01:141
421399230,0cyclictest0-21swapper/112:21:361
421399230,0cyclictest0-21swapper/111:32:521
421399230,0cyclictest0-21swapper/110:49:431
4208992323,0cyclictest0-21swapper/012:28:170
4208992323,0cyclictest0-21swapper/012:17:500
4208992323,0cyclictest0-21swapper/012:14:480
4208992323,0cyclictest0-21swapper/011:10:280
4208992321,2cyclictest0-21swapper/011:35:070
4208992321,1cyclictest0-21swapper/008:55:000
420899230,2cyclictest2712-21sh12:07:520
420899230,2cyclictest16811-21apt-get07:37:560
420899230,23cyclictest0-21swapper/010:52:120
420899230,23cyclictest0-21swapper/009:23:090
420899230,23cyclictest0-21swapper/009:10:130
420899230,22cyclictest21042-21sh09:30:430
420899230,22cyclictest1512-21apt-get09:42:560
420899230,22cyclictest10760-21cron08:30:010
420899230,22cyclictest0-21swapper/010:32:430
420899230,22cyclictest0-21swapper/009:15:030
420899230,21cyclictest0-21swapper/011:00:190
420899230,0cyclictest30360-21diskmemload10:01:130
420899230,0cyclictest30360-21diskmemload09:28:300
420899230,0cyclictest0-21swapper/012:00:230
420899230,0cyclictest0-21swapper/010:41:390
4221992222,0cyclictest0-21swapper/310:02:213
4221992221,1cyclictest0-21swapper/311:20:053
4221992221,0cyclictest0-21swapper/311:45:453
4221992220,1cyclictest0-21swapper/312:30:503
4221992220,1cyclictest0-21swapper/312:26:143
4221992220,1cyclictest0-21swapper/310:16:103
422199220,21cyclictest30360-21diskmemload09:25:293
422199220,21cyclictest114252chrt09:51:013
422199220,21cyclictest0-21swapper/311:50:423
422199220,21cyclictest0-21swapper/310:52:063
422199220,1cyclictest0-21swapper/311:13:373
422199220,0cyclictest0-21swapper/312:23:233
4215992222,0cyclictest0-21swapper/209:30:562
4215992222,0cyclictest0-21swapper/209:15:522
421599220,22cyclictest30360-21diskmemload11:25:552
421599220,22cyclictest15249-21ssh11:20:452
421599220,21cyclictest6570-21perf07:15:002
421599220,21cyclictest1115-21turbostat08:10:002
421599220,21cyclictest0-21swapper/212:25:212
421599220,1cyclictest29873-21ssh12:31:102
421599220,1cyclictest2065-21ssh11:09:052
421599220,0cyclictest30360-21diskmemload09:26:192
421599220,0cyclictest30360-21diskmemload09:12:102
421599220,0cyclictest0-21swapper/211:43:552
421599220,0cyclictest0-21swapper/211:31:242
4213992222,0cyclictest0-21swapper/112:25:211
4213992222,0cyclictest0-21swapper/111:43:211
4213992222,0cyclictest0-21swapper/110:40:341
4213992222,0cyclictest0-21swapper/110:25:281
4213992222,0cyclictest0-21swapper/110:15:501
4213992222,0cyclictest0-21swapper/109:10:201
4213992221,1cyclictest31149-21/usr/sbin/munin12:32:561
4213992221,1cyclictest0-21swapper/112:11:121
4213992221,1cyclictest0-21swapper/109:25:491
4213992220,1cyclictest9050-21idleruntime-cro07:20:001
4213992220,1cyclictest0-21swapper/112:15:121
421399220,22cyclictest25443-21sh11:01:361
421399220,21cyclictest28314-21latency_hist08:00:001
421399220,21cyclictest27569-21ssh12:00:061
421399220,21cyclictest18475-21apt-get08:47:571
421399220,21cyclictest14311-21apt-get07:32:571
421399220,21cyclictest0-21swapper/108:42:561
421399220,21cyclictest0-21swapper/107:42:561
421399220,1cyclictest32304-21rm09:40:331
421399220,1cyclictest22304-21ssh11:55:271
421399220,1cyclictest19510-21sh10:56:161
421399220,1cyclictest0-21swapper/109:21:291
421399220,1cyclictest0-21swapper/107:15:001
421399220,0cyclictest30360-21diskmemload09:55:361
421399220,0cyclictest0-21swapper/110:07:321
4208992222,0cyclictest30360-21diskmemload10:55:170
4208992221,1cyclictest25879-21ssh11:30:080
4208992220,1cyclictest0-21swapper/010:21:450
4208992220,1cyclictest0-21swapper/007:17:560
420899220,21cyclictest4650-21apt-get07:12:550
420899220,21cyclictest30360-21diskmemload12:20:290
420899220,21cyclictest0-21swapper/011:55:510
420899220,21cyclictest0-21swapper/009:50:200
4221992120,0cyclictest13662-21apt-get08:37:563
4221992119,1cyclictest0-21swapper/308:27:553
422199210,20cyclictest0-21swapper/308:57:583
4215992121,0cyclictest0-21swapper/210:10:202
4215992120,1cyclictest28469-21apt-get09:07:562
4215992120,1cyclictest21622-21apt-get07:47:582
4215992120,1cyclictest13544-21sh10:50:302
4215992119,1cyclictest0-21swapper/212:36:002
421599210,20cyclictest9519-21apt-get07:22:562
4213992121,0cyclictest0-21swapper/108:27:551
4213992120,0cyclictest13662-21apt-get08:37:561
421399210,21cyclictest0-21swapper/112:35:291
4208992121,0cyclictest0-21swapper/008:32:570
4208992120,0cyclictest3997-21apt-get08:17:570
420899210,21cyclictest0-21swapper/007:47:580
420899210,0cyclictest0-21swapper/009:35:110
4221992018,1cyclictest5916-21idleruntime-cro08:20:003
422199200,20cyclictest0-21swapper/308:47:573
4215992020,0cyclictest16811-21apt-get07:37:572
4215992020,0cyclictest16081-21apt-get08:42:572
4215992020,0cyclictest0-21swapper/208:22:582
4215992020,0cyclictest0-21swapper/207:17:562
4215992019,1cyclictest20871-21apt-get08:52:582
4215992018,1cyclictest27586-21awk09:05:002
421599200,20cyclictest0-21swapper/207:57:572
4213992020,0cyclictest0-21swapper/107:47:581
4213992019,0cyclictest6425-21apt-get08:22:581
421399200,0cyclictest0-21swapper/107:37:571
4208992020,0cyclictest0-21swapper/008:07:560
4208992019,1cyclictest0-21swapper/009:00:000
4208992019,1cyclictest0-21swapper/007:22:570
420899200,0cyclictest0-21swapper/008:22:580
4221991919,0cyclictest0-21swapper/309:02:563
4221991919,0cyclictest0-21swapper/308:42:563
4221991919,0cyclictest0-21swapper/307:42:563
4221991919,0cyclictest0-21swapper/307:27:563
4221991919,0cyclictest0-21swapper/307:17:563
4221991919,0cyclictest0-21swapper/307:12:553
4215991919,0cyclictest28826-21apt-get08:02:572
4215991917,1cyclictest25200-21munin-run09:00:002
4213991919,0cyclictest0-21swapper/109:07:561
4208991919,0cyclictest0-21swapper/008:47:570
4208991919,0cyclictest0-21swapper/008:42:560
4208991919,0cyclictest0-21swapper/007:52:570
4221991818,0cyclictest0-21swapper/308:52:583
4221991818,0cyclictest0-21swapper/307:22:563
4221991816,2cyclictest30383-21wc09:10:003
4215991818,0cyclictest0-21swapper/208:37:562
421599180,17cyclictest0-21swapper/208:17:572
4213991818,0cyclictest0-21swapper/108:52:581
4208991818,0cyclictest0-21swapper/008:37:560
4208991817,1cyclictest27598-21apt-get09:05:020
4208991817,0cyclictest0-21swapper/007:27:560
4208991815,2cyclictest3498-21cron08:15:000
4221991717,0cyclictest24016-21apt-get07:52:573
422199170,0cyclictest0-21swapper/307:49:123
4215991717,0cyclictest11912-21apt-get07:27:562
4213991717,0cyclictest0-21swapper/107:27:561
4213991717,0cyclictest0-21swapper/107:22:561
4213991716,0cyclictest0-21swapper/108:12:571
4208991717,0cyclictest0-21swapper/007:42:560
4221991614,1cyclictest8343-21grep08:25:013
4215991616,0cyclictest0-21swapper/208:47:572
4215991616,0cyclictest0-21swapper/207:32:572
4213991616,0cyclictest0-21swapper/108:02:561
4208991616,0cyclictest0-21swapper/009:03:060
4221991515,0cyclictest0-21swapper/308:02:563
4221991515,0cyclictest0-21swapper/307:37:573
4215991515,0cyclictest8869-21apt-get08:27:552
421399152,11cyclictest1710-21apache208:59:251
420899150,1cyclictest0-21swapper/007:58:020
4221991414,0cyclictest0-21swapper/308:30:013
422199140,14cyclictest0-21swapper/308:10:443
422199140,14cyclictest0-21swapper/307:30:523
421599140,14cyclictest0-21swapper/208:10:042
421599140,14cyclictest0-21swapper/207:50:372
421599140,14cyclictest0-21swapper/207:40:342
4213991414,0cyclictest0-21swapper/108:30:061
4213991414,0cyclictest0-21swapper/108:15:281
4213991414,0cyclictest0-21swapper/107:50:561
421399140,14cyclictest0-21swapper/109:01:041
4208991414,0cyclictest0-21swapper/008:00:370
420899140,14cyclictest0-21swapper/007:30:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional