You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 23:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Sat Sep 19, 2026 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1312199260,25cyclictest24887-21ssh10:53:063
13115992623,2cyclictest6440-21diskmemload09:57:410
13117992523,1cyclictest28-21ksoftirqd/210:45:012
13117992521,0cyclictest151rcu_preempt09:15:362
1311799250,24cyclictest6440-21diskmemload12:03:422
1311699250,24cyclictest0-21swapper/110:49:231
1311599251,1cyclictest0-21swapper/010:52:410
13121992422,1cyclictest7446-21cron12:05:003
1312199240,24cyclictest6440-21diskmemload11:55:473
1312199240,23cyclictest28349-21wc11:55:003
1312199240,1cyclictest19184-21sh12:15:343
13117992421,2cyclictest14824-21cron08:20:012
13117992421,2cyclictest14824-21cron08:20:012
13117992421,2cyclictest0-21swapper/212:09:132
13117992421,1cyclictest0-21swapper/212:12:272
1311799240,23cyclictest0-21swapper/208:10:002
1311799240,0cyclictest151rcu_preempt10:18:182
1311799240,0cyclictest0-21swapper/210:58:382
13116992424,0cyclictest0-21swapper/109:45:161
13116992421,2cyclictest6440-21diskmemload09:12:411
1311699240,24cyclictest0-21swapper/111:52:091
1311699240,24cyclictest0-21swapper/108:47:441
1311699240,23cyclictest75-21kswapd010:25:021
1311699240,23cyclictest313-21systemd-journal09:25:011
1311699240,23cyclictest17730-21apt-get08:27:431
1311699240,23cyclictest0-21swapper/110:34:261
1311699240,0cyclictest6440-21diskmemload10:51:491
1311699240,0cyclictest0-21swapper/110:38:451
1311699240,0cyclictest0-21swapper/110:19:141
13115992423,1cyclictest0-21swapper/009:22:290
13115992422,1cyclictest0-21swapper/009:40:310
1311599240,23cyclictest26245-21ssh11:52:490
1311599240,23cyclictest16399-21ls12:12:480
13121992323,0cyclictest0-21swapper/311:00:393
13121992323,0cyclictest0-21swapper/310:23:363
13121992323,0cyclictest0-21swapper/309:52:473
13121992321,1cyclictest0-21swapper/309:39:043
1312199230,2cyclictest11017-21ssh10:41:323
1312199230,23cyclictest0-21swapper/310:03:013
1312199230,23cyclictest0-21swapper/309:30:243
1312199230,23cyclictest0-21swapper/309:26:563
1312199230,23cyclictest0-21swapper/309:21:083
1312199230,23cyclictest0-21swapper/309:16:353
1312199230,23cyclictest0-21swapper/309:12:423
1312199230,22cyclictest27952-21ssh09:57:463
1312199230,22cyclictest16211-21ssh10:17:193
1312199230,22cyclictest12844-21ssh11:41:123
1312199230,22cyclictest0-21swapper/312:12:033
1312199230,22cyclictest0-21swapper/311:47:593
1312199230,0cyclictest0-21swapper/312:33:373
1312199230,0cyclictest0-21swapper/311:21:543
1312199230,0cyclictest0-21swapper/310:09:343
13117992323,0cyclictest6440-21diskmemload10:26:132
13117992323,0cyclictest0-21swapper/210:38:542
13117992322,1cyclictest28-21ksoftirqd/212:23:332
13117992321,1cyclictest0-21swapper/212:37:422
13117992320,2cyclictest32748-21ssh10:31:572
1311799230,23cyclictest0-21swapper/211:19:162
1311799230,23cyclictest0-21swapper/210:01:262
1311799230,23cyclictest0-21swapper/209:49:392
1311799230,22cyclictest512-21ssh11:58:382
1311799230,22cyclictest4811-21ssh10:06:482
1311799230,22cyclictest20432-21rm12:17:212
1311799230,22cyclictest12636-21diskmemload09:43:362
1311799230,22cyclictest0-21swapper/211:00:532
1311799230,0cyclictest0-21swapper/212:30:482
1311799230,0cyclictest0-21swapper/211:35:142
1311799230,0cyclictest0-21swapper/211:05:082
1311799230,0cyclictest0-21swapper/209:10:532
13116992323,0cyclictest0-21swapper/112:37:061
13116992323,0cyclictest0-21swapper/112:23:461
13116992323,0cyclictest0-21swapper/111:45:061
13116992323,0cyclictest0-21swapper/111:11:281
13116992323,0cyclictest0-21swapper/109:59:401
13116992323,0cyclictest0-21swapper/109:30:321
13116992323,0cyclictest0-21swapper/109:28:391
13116992321,1cyclictest26228-21apt-get10:55:021
13116992321,1cyclictest0-21swapper/112:30:391
13116992321,1cyclictest0-21swapper/112:09:121
13116992321,1cyclictest0-21swapper/111:02:441
13116992321,1cyclictest0-21swapper/109:15:391
1311699230,23cyclictest0-21swapper/112:28:501
1311699230,22cyclictest17708-21rm11:16:411
1311699230,22cyclictest17001-21ssh11:44:441
1311699230,1cyclictest0-21swapper/110:20:201
1311699230,0cyclictest0-21swapper/112:00:411
1311699230,0cyclictest0-21swapper/111:55:331
1311699230,0cyclictest0-21swapper/109:53:271
13115992323,0cyclictest0-21swapper/010:24:530
13115992323,0cyclictest0-21swapper/010:10:070
13115992323,0cyclictest0-21swapper/010:06:310
13115992323,0cyclictest0-21swapper/010:01:140
13115992323,0cyclictest0-21swapper/009:35:350
13115992323,0cyclictest0-21swapper/009:28:170
13115992322,1cyclictest2417-21ssh12:00:220
13115992321,1cyclictest26055-21ssh12:22:240
13115992321,1cyclictest0-21swapper/010:40:000
1311599230,23cyclictest6440-21diskmemload12:05:010
1311599230,23cyclictest0-21swapper/010:17:350
1311599230,22cyclictest29273-21perf08:50:000
1311599230,22cyclictest2781-21sh10:32:590
1311599230,22cyclictest27629-21awk07:40:010
1311599230,22cyclictest2615-21wc09:35:000
1311599230,22cyclictest14459-21ssh09:45:440
1311599230,22cyclictest10712-21sh10:41:090
1311599230,1cyclictest6440-21diskmemload11:46:000
1311599230,0cyclictest21402-21apt-get09:52:400
1311599230,0cyclictest0-21swapper/012:31:530
1311599230,0cyclictest0-21swapper/012:25:310
1311599230,0cyclictest0-21swapper/009:15:200
13121992222,0cyclictest6440-21diskmemload10:11:223
13121992222,0cyclictest0-21swapper/312:07:083
13121992222,0cyclictest0-21swapper/311:33:213
13121992222,0cyclictest0-21swapper/311:25:593
13121992222,0cyclictest0-21swapper/311:25:593
13121992220,1cyclictest8263-21sh09:40:013
13121992220,1cyclictest0-21swapper/311:18:033
13121992220,1cyclictest0-21swapper/310:47:013
1312199221,1cyclictest27858-21ssh10:56:273
1312199220,22cyclictest0-21swapper/312:20:593
1312199220,21cyclictest9693-21ssh11:08:293
1312199220,21cyclictest25082-21idleruntime-cro07:35:013
1312199220,21cyclictest0-21swapper/310:25:013
1312199220,1cyclictest31554-21ssh12:27:203
1312199220,1cyclictest2412-21perf07:55:003
1312199220,1cyclictest0-21swapper/308:45:003
1312199220,0cyclictest0-21swapper/312:38:293
13117992222,0cyclictest6440-21diskmemload11:54:082
13117992222,0cyclictest0-21swapper/210:12:152
13117992222,0cyclictest0-21swapper/209:50:162
13117992221,1cyclictest6440-21diskmemload11:20:282
13117992221,1cyclictest20024-21ssh10:20:042
13117992220,1cyclictest0-21swapper/211:40:342
13117992220,1cyclictest0-21swapper/210:50:512
13117992220,1cyclictest0-21swapper/209:30:392
13117992220,1cyclictest0-21swapper/209:25:102
13117992220,0cyclictest151rcu_preempt09:55:442
1311799220,22cyclictest0-21swapper/210:46:032
1311799220,21cyclictest11827-21sh11:11:132
1311799220,1cyclictest31571-21ssh12:27:222
1311799220,1cyclictest271rcuc/209:10:012
1311799220,1cyclictest0-21swapper/211:30:452
1311799220,1cyclictest0-21swapper/211:29:512
1311799220,1cyclictest0-21swapper/211:29:512
1311799220,0cyclictest0-21swapper/209:35:412
13116992222,0cyclictest0-21swapper/111:34:141
13116992222,0cyclictest0-21swapper/110:07:091
13116992221,1cyclictest0-21swapper/108:07:401
13116992221,0cyclictest15333-21apt-get08:22:411
1311699220,21cyclictest32423-21munin-plugin-st07:50:001
1311699220,21cyclictest30558-21sh10:00:031
1311699220,21cyclictest12052-21dump-pmu-power08:15:001
1311699220,1cyclictest6440-21diskmemload12:11:141
1311699220,1cyclictest0-21swapper/111:07:081
1311699220,1cyclictest0-21swapper/109:41:081
1311699220,0cyclictest0-21swapper/112:18:131
1311699220,0cyclictest0-21swapper/110:43:061
1311699220,0cyclictest0-21swapper/109:35:121
13115992222,0cyclictest0-21swapper/011:31:090
13115992222,0cyclictest0-21swapper/009:07:410
13115992221,1cyclictest6440-21diskmemload12:35:090
13115992220,1cyclictest0-21swapper/010:25:020
1311599220,21cyclictest27287-21ssh10:55:440
1311599220,21cyclictest22053-21dump-pmu-power08:35:010
1311599220,21cyclictest18858-21ssh12:15:010
1311599220,21cyclictest12686-21ssh11:40:520
1311599220,21cyclictest0-21swapper/011:55:160
1311599220,21cyclictest0-21swapper/011:35:190
1311599220,21cyclictest0-21swapper/007:22:410
1311599220,21cyclictest0-21swapper/007:17:400
1311599220,1cyclictest783-21snmpd11:02:500
1311599220,1cyclictest4077-21munin-run09:05:000
1311599220,1cyclictest11108-21ssh11:10:070
1311599220,1cyclictest0-21swapper/010:46:440
1311599220,0cyclictest6440-21diskmemload11:06:510
1312199210,21cyclictest0-21swapper/310:37:403
1312199210,20cyclictest6553-21sh11:35:113
1312199210,20cyclictest0-21swapper/308:17:413
1312199210,20cyclictest0-21swapper/308:17:413
1312199210,1cyclictest12066-21perf08:15:003
1312199210,0cyclictest0-21swapper/310:31:293
1312199210,0cyclictest0-21swapper/309:45:103
13117992121,0cyclictest18377-21apt-get07:22:412
13117992119,1cyclictest4811-21perf08:00:002
13117992119,1cyclictest0-21swapper/208:55:002
1311799210,20cyclictest0-21swapper/208:57:412
1311799210,0cyclictest0-21swapper/208:42:422
13116992121,0cyclictest0-21swapper/110:10:341
13116992120,1cyclictest25562-21apt-get07:37:401
13116992120,1cyclictest0-21swapper/108:32:411
13116992119,1cyclictest0-21swapper/111:20:221
13116992118,2cyclictest6466-21apt09:10:011
1311699210,21cyclictest0-21swapper/111:25:031
1311699210,21cyclictest0-21swapper/111:25:031
1311699210,20cyclictest0-21swapper/107:12:421
1311699210,1cyclictest2377-21idleruntime-cro07:55:001
13115992119,1cyclictest0-21swapper/007:45:010
1311599210,21cyclictest0-21swapper/011:25:120
1311599210,21cyclictest0-21swapper/011:25:120
1311599210,1cyclictest23330-21ssh11:21:470
13121992020,0cyclictest7669-21apt-get08:07:403
13121992020,0cyclictest0-21swapper/307:17:413
1312199200,0cyclictest20124-21apt-get08:32:413
13117992020,0cyclictest23169-21apt-get07:32:412
13117992020,0cyclictest0-21swapper/208:47:442
13117992020,0cyclictest0-21swapper/207:37:412
13117992020,0cyclictest0-21swapper/207:17:412
1311799200,19cyclictest2134-21apt-get09:02:432
1311799200,0cyclictest0-21swapper/207:42:412
13116992020,0cyclictest0-21swapper/109:02:431
13116992020,0cyclictest0-21swapper/108:57:411
13115992020,0cyclictest0-21swapper/007:52:420
13115992018,1cyclictest0-21swapper/007:15:000
1311599200,0cyclictest24939-21apt-get08:42:420
13121991919,0cyclictest0-21swapper/308:52:433
13121991918,1cyclictest4080-21perf09:05:003
13121991918,0cyclictest0-21swapper/307:22:403
1312199190,18cyclictest13565-21apt-get07:12:413
1312199190,17cyclictest313-21systemd-journal08:05:003
13117991918,0cyclictest22522-21apt-get08:37:412
13116991919,0cyclictest0-21swapper/107:32:491
13115991919,0cyclictest0-21swapper/008:27:430
13115991919,0cyclictest0-21swapper/007:47:410
13115991919,0cyclictest0-21swapper/007:27:410
13115991919,0cyclictest0-21swapper/007:27:410
13115991917,1cyclictest12039-21latency_hist08:15:000
13121991818,0cyclictest25562-21apt-get07:37:403
13115991818,0cyclictest0-21swapper/008:15:020
13115991818,0cyclictest0-21swapper/008:15:020
13121991717,0cyclictest0-21swapper/309:07:403
13121991717,0cyclictest0-21swapper/307:47:413
13121991714,2cyclictest17240-21cron08:25:013
13117991717,0cyclictest0-21swapper/207:52:422
13117991715,1cyclictest0-21swapper/207:30:012
13117991715,1cyclictest0-21swapper/207:30:012
1311799170,16cyclictest0-21swapper/207:12:422
13116991717,0cyclictest0-21swapper/107:22:411
1311699170,16cyclictest7270-21sleep08:05:001
13121991616,0cyclictest0-21swapper/307:27:413
13121991616,0cyclictest0-21swapper/307:27:413
1312199160,15cyclictest17730-21apt-get08:27:433
13117991616,0cyclictest0-21swapper/208:32:412
13117991616,0cyclictest0-21swapper/208:02:422
13117991614,1cyclictest324562sleep207:50:002
13116991616,0cyclictest20771-21apt-get07:27:411
13116991616,0cyclictest20771-21apt-get07:27:411
13116991615,1cyclictest0-21swapper/107:20:001
13116991614,1cyclictest0-21swapper/108:42:421
13115991616,0cyclictest0-21swapper/008:57:410
13115991616,0cyclictest0-21swapper/008:52:430
13115991616,0cyclictest0-21swapper/008:37:410
13115991616,0cyclictest0-21swapper/008:02:420
13115991616,0cyclictest0-21swapper/007:32:410
13115991615,1cyclictest15333-21apt-get08:22:410
13121991515,0cyclictest2861-21apt-get07:57:433
13115991514,1cyclictest783-21snmpd07:55:020
13121991414,0cyclictest0-21swapper/307:40:133
1312199140,14cyclictest0-21swapper/308:55:013
1312199140,14cyclictest0-21swapper/308:45:143
1312199140,14cyclictest0-21swapper/308:35:263
1311799140,0cyclictest0-21swapper/208:25:212
1311799140,0cyclictest0-21swapper/208:20:252
13116991414,0cyclictest0-21swapper/108:50:121
13116991414,0cyclictest0-21swapper/107:40:431
1311599140,14cyclictest0-21swapper/008:06:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional