You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 00:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jul 17, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3064992920,5cyclictest0-21swapper/110:16:041
306499290,1cyclictest61682chrt11:42:101
306499280,1cyclictest19619-21idleruntime-cro11:25:011
306499270,2cyclictest21109-21sh11:26:451
306499270,27cyclictest0-21swapper/111:10:541
306499270,26cyclictest1091-21ssh09:12:491
3064992624,1cyclictest0-21swapper/112:12:331
306499260,25cyclictest312982sleep109:40:341
306499260,25cyclictest29826-21ssh09:38:571
306499260,25cyclictest29227-21diskmemload10:12:521
306499260,25cyclictest11849-21ssh11:17:331
306499260,22cyclictest13136-21ssh10:22:111
306499260,21cyclictest32242-21ssh12:04:561
306499260,21cyclictest0-21swapper/111:02:011
306499260,1cyclictest26210-21ssh11:59:181
3061992624,1cyclictest0-21swapper/010:54:370
306799250,24cyclictest29227-21diskmemload11:54:282
306799250,1cyclictest0-21swapper/212:19:472
3064992522,3cyclictest0-21swapper/110:42:001
3064992521,3cyclictest0-21swapper/109:53:591
3064992520,5cyclictest0-21swapper/110:52:251
306499251,0cyclictest0-21swapper/109:25:151
306499250,24cyclictest0-21swapper/110:28:101
306499250,23cyclictest0-21swapper/111:07:251
306499250,21cyclictest0-21swapper/112:36:041
306499250,1cyclictest606-21dbus-daemon07:25:011
306499250,0cyclictest0-21swapper/110:06:361
306499250,0cyclictest0-21swapper/109:34:381
306199255,0cyclictest62550irq/127-eno111:46:210
3061992523,1cyclictest0-21swapper/010:32:310
306199250,24cyclictest29227-21diskmemload11:24:500
306199250,24cyclictest0-21swapper/010:47:240
306199250,1cyclictest1043-21ssh10:39:340
3071992423,1cyclictest29227-21diskmemload10:29:373
3071992422,1cyclictest29227-21diskmemload09:55:013
307199240,24cyclictest30477-21sh09:39:533
307199240,1cyclictest0-21swapper/309:57:033
3067992422,1cyclictest29227-21diskmemload09:57:282
3067992422,1cyclictest2444-21sh11:37:512
3067992422,1cyclictest0-21swapper/212:27:102
3067992420,1cyclictest0-21swapper/210:15:252
306799240,24cyclictest29227-21diskmemload12:11:102
306799240,23cyclictest31452-21ssh09:12:242
306799240,23cyclictest30751-21sh11:35:012
306799240,23cyclictest23887-21idleruntime-cro11:00:002
306799240,23cyclictest0-21swapper/210:50:492
306799240,1cyclictest0-21swapper/212:21:252
306799240,1cyclictest0-21swapper/211:19:102
306799240,1cyclictest0-21swapper/210:37:582
3064992424,0cyclictest0-21swapper/112:30:191
3064992423,1cyclictest0-21swapper/109:20:541
3064992422,2cyclictest0-21swapper/111:50:591
3064992419,4cyclictest0-21swapper/110:38:391
306499240,23cyclictest0-21swapper/109:57:261
306499240,20cyclictest3300-21ssh11:39:051
306499240,0cyclictest0-21swapper/112:20:211
306499240,0cyclictest0-21swapper/112:08:161
3061992423,1cyclictest0-21swapper/010:17:220
3061992423,0cyclictest0-21swapper/009:59:080
3061992421,2cyclictest2901-21ssh10:41:470
306199240,23cyclictest29803-21rm10:07:310
306199240,23cyclictest29227-21diskmemload11:33:450
306199240,23cyclictest29227-21diskmemload09:32:550
306199240,23cyclictest141rcuc/012:37:240
306199240,23cyclictest0-21swapper/008:12:230
306199240,0cyclictest29227-21diskmemload11:42:550
306199240,0cyclictest29227-21diskmemload09:25:200
306199240,0cyclictest0-21swapper/010:59:330
3071992323,0cyclictest0-21swapper/312:06:363
3071992323,0cyclictest0-21swapper/309:30:143
3071992322,1cyclictest29227-21diskmemload11:35:123
3071992322,1cyclictest29227-21diskmemload10:45:183
3071992321,1cyclictest606-21dbus-daemon08:40:003
3071992321,1cyclictest17475-21ssh11:52:233
3071992321,1cyclictest0-21swapper/311:56:183
3071992321,1cyclictest0-21swapper/308:57:243
3071992320,2cyclictest30057-21ssh09:10:443
307199230,2cyclictest3852-21ssh09:16:163
307199230,2cyclictest15460-21ssh12:18:073
307199230,23cyclictest29227-21diskmemload11:01:543
307199230,23cyclictest0-21swapper/312:30:003
307199230,23cyclictest0-21swapper/310:13:073
307199230,23cyclictest0-21swapper/309:24:073
307199230,22cyclictest7380-21sh11:13:483
307199230,22cyclictest4260-21ssh12:37:303
307199230,22cyclictest28711-21ssh10:35:313
307199230,22cyclictest25093-21ssh10:02:513
307199230,22cyclictest15538-21ssh09:27:013
307199230,22cyclictest12004-21sh10:20:393
307199230,22cyclictest0-21swapper/311:41:223
3067992323,0cyclictest29227-21diskmemload11:45:502
3067992323,0cyclictest0-21swapper/211:14:102
3067992323,0cyclictest0-21swapper/210:46:112
3067992323,0cyclictest0-21swapper/210:34:312
3067992323,0cyclictest0-21swapper/209:41:062
3067992322,1cyclictest29227-21diskmemload11:24:162
3067992321,1cyclictest0-21swapper/212:35:302
3067992321,1cyclictest0-21swapper/210:06:342
3067992321,1cyclictest0-21swapper/209:27:182
3067992318,0cyclictest0-21swapper/211:01:002
306799230,23cyclictest0-21swapper/211:43:242
306799230,23cyclictest0-21swapper/211:26:202
306799230,23cyclictest0-21swapper/210:22:072
306799230,22cyclictest3009-21sh09:15:132
306799230,22cyclictest29996-21ssh11:05:152
306799230,22cyclictest29227-21diskmemload12:00:412
306799230,1cyclictest0-21swapper/210:26:412
306799230,0cyclictest29227-21diskmemload09:53:422
306799230,0cyclictest0-21swapper/210:40:262
306799230,0cyclictest0-21swapper/210:01:412
306799230,0cyclictest0-21swapper/209:30:072
3064992323,0cyclictest0-21swapper/110:56:491
3064992323,0cyclictest0-21swapper/110:33:191
3064992321,1cyclictest22532-21ssh10:01:411
3064992320,3cyclictest0-21swapper/109:45:131
3064992319,4cyclictest0-21swapper/110:45:021
306499231,21cyclictest0-21swapper/109:10:011
306499230,2cyclictest4110-21sed07:12:261
306499230,23cyclictest0-21swapper/109:15:261
306499230,22cyclictest29227-21diskmemload11:47:191
306499230,22cyclictest27053-21sh12:28:501
3061992323,0cyclictest29227-21diskmemload11:55:380
3061992323,0cyclictest0-21swapper/009:51:060
3061992322,1cyclictest29227-21diskmemload09:35:160
3061992322,1cyclictest29227-21diskmemload09:10:050
3061992321,1cyclictest674-21sh12:05:430
3061992320,2cyclictest3536-21sh11:10:540
3061992320,2cyclictest14099-21if_enp1s010:22:280
306199230,2cyclictest31732-21ssh12:04:080
306199230,23cyclictest0-21swapper/010:28:590
306199230,23cyclictest0-21swapper/009:49:490
306199230,23cyclictest0-21swapper/009:16:460
306199230,22cyclictest29227-21diskmemload12:26:140
306199230,22cyclictest29227-21diskmemload10:01:590
306199230,22cyclictest24507-21ssh11:00:270
306199230,22cyclictest22041-21dump-pmu-power08:55:000
306199230,22cyclictest0-21swapper/011:50:020
306199230,22cyclictest0-21swapper/011:17:470
306199230,22cyclictest0-21swapper/011:06:220
306199230,22cyclictest0-21swapper/008:22:240
306199230,0cyclictest0-21swapper/010:14:100
306199230,0cyclictest0-21swapper/009:40:360
3071992222,0cyclictest29227-21diskmemload12:01:533
3071992222,0cyclictest0-21swapper/312:32:153
3071992222,0cyclictest0-21swapper/310:55:123
3071992221,1cyclictest0-21swapper/311:46:343
3071992221,1cyclictest0-21swapper/307:12:233
3071992220,2cyclictest2965-21ssh09:43:473
3071992220,1cyclictest609-21rs:main3
3071992220,1cyclictest5780-21ssh12:10:013
307199220,22cyclictest29227-21diskmemload09:45:133
307199220,21cyclictest8683-21ssh11:15:163
307199220,21cyclictest7640-21apt-get08:27:243
307199220,21cyclictest29227-21diskmemload10:06:433
307199220,21cyclictest24583-21ssh11:29:103
307199220,21cyclictest0-21swapper/312:21:063
307199220,21cyclictest0-21swapper/311:20:323
307199220,21cyclictest0-21swapper/310:30:013
307199220,1cyclictest0-21swapper/310:16:273
307199220,0cyclictest25630-21apt-get07:57:253
3067992222,0cyclictest0-21swapper/211:55:282
3067992220,1cyclictest606-21dbus-daemon09:05:012
3067992219,2cyclictest28-21ksoftirqd/208:05:002
306799220,22cyclictest0-21swapper/210:10:472
306799220,21cyclictest29544-21ssh12:31:542
306799220,21cyclictest29227-21diskmemload09:20:052
306799220,21cyclictest26828-21ssh09:37:142
306799220,21cyclictest0-21swapper/212:05:032
306799220,0cyclictest0-21swapper/209:45:262
3064992219,2cyclictest4791-21turbostat08:20:011
306499220,21cyclictest12179-21sh12:16:031
306499220,21cyclictest0-21swapper/107:57:251
306499220,21cyclictest0-21swapper/107:17:241
306499220,1cyclictest25732-21ssh11:30:271
306499220,1cyclictest12047-21wc08:35:001
3061992221,1cyclictest0-21swapper/011:27:240
3061992220,1cyclictest19266-21munin-run08:50:000
306199220,21cyclictest4816-21sendmail-msp08:20:010
306199220,21cyclictest3475-21apt-get07:12:230
306199220,21cyclictest29227-21diskmemload12:15:090
306199220,21cyclictest27293-21apt09:07:250
306199220,21cyclictest0-21swapper/012:20:190
306199220,1cyclictest29556-21ssh12:31:550
306199220,1cyclictest19977-21cron07:45:000
306199220,1cyclictest0-21swapper/009:20:110
306199220,0cyclictest0-21swapper/012:14:070
3071992121,0cyclictest0-21swapper/307:47:243
3071992119,1cyclictest17559-21cron07:40:013
307199210,20cyclictest0-21swapper/309:07:253
307199210,20cyclictest0-21swapper/308:07:273
307199210,1cyclictest0-21swapper/308:47:233
307199210,0cyclictest20089-21apt-get08:52:263
3067992118,2cyclictest32372-21cron08:10:002
306799210,0cyclictest0-21swapper/207:22:242
3064992119,1cyclictest17563-21cron07:40:011
306499210,20cyclictest0-21swapper/107:42:331
306499210,1cyclictest25949-21ntp_states09:02:291
306499210,0cyclictest0-21swapper/108:40:001
3061992120,1cyclictest19986-21apt-get07:45:010
306199210,1cyclictest24454-21idleruntime-cro09:00:010
3071992020,0cyclictest0-21swapper/308:17:253
3067992020,0cyclictest2823-21apt-get08:17:252
3067992020,0cyclictest0-21swapper/208:32:252
3067992019,1cyclictest5247-21apt-get08:22:242
3064992020,0cyclictest0-21swapper/108:42:241
306499200,1cyclictest0-21swapper/108:47:281
306499200,1cyclictest0-21swapper/108:30:011
306499200,1cyclictest0-21swapper/108:02:251
3061992020,0cyclictest0-21swapper/008:07:270
306199200,20cyclictest0-21swapper/007:57:250
306199200,19cyclictest0-21swapper/008:37:240
3071991919,0cyclictest0-21swapper/309:02:233
3071991918,0cyclictest13134-21apt-get07:32:243
3067991919,0cyclictest0-21swapper/207:32:242
3067991919,0cyclictest0-21swapper/207:27:232
3067991917,1cyclictest0-21swapper/208:50:002
3067991916,2cyclictest20001-21apt-get07:45:002
306799190,0cyclictest0-21swapper/208:12:222
3064991919,0cyclictest0-21swapper/108:12:221
3064991919,0cyclictest0-21swapper/108:07:271
3064991913,5cyclictest313-21systemd-journal07:53:421
306499180,17cyclictest0-21swapper/108:52:261
306499180,17cyclictest0-21swapper/108:22:241
3061991818,0cyclictest10736-21apt-get07:27:240
3061991818,0cyclictest0-21swapper/009:02:230
3071991717,0cyclictest0-21swapper/308:22:243
3071991717,0cyclictest0-21swapper/308:02:253
3071991717,0cyclictest0-21swapper/307:42:243
3071991717,0cyclictest0-21swapper/307:22:253
307199170,2cyclictest0-21swapper/307:28:113
3067991717,0cyclictest0-21swapper/208:50:022
3067991717,0cyclictest0-21swapper/207:52:252
3067991717,0cyclictest0-21swapper/207:17:232
3064991717,0cyclictest0-21swapper/108:57:251
3064991717,0cyclictest0-21swapper/107:32:241
3071991616,0cyclictest369-21apt-get08:12:223
3071991613,2cyclictest15950-21ntp_states08:42:303
3067991615,1cyclictest27294-21apt-get09:07:252
3067991614,1cyclictest9648-21perf08:30:012
3067991614,1cyclictest313-21systemd-journal07:15:002
306499160,1cyclictest20961-21cpuspeed_turbos07:47:241
3061991616,0cyclictest0-21swapper/008:27:240
3061991616,0cyclictest0-21swapper/007:37:250
3061991614,1cyclictest28048-21apt-get08:02:250
3061991614,1cyclictest0-21swapper/007:22:350
306199160,15cyclictest0-21swapper/007:32:230
3071991513,1cyclictest0-21swapper/308:35:003
307199150,0cyclictest23236-21apt-get07:52:253
3067991513,1cyclictest0-21swapper/208:37:312
3064991513,2cyclictest0-21swapper/107:25:571
3061991515,0cyclictest0-21swapper/008:32:250
3061991515,0cyclictest0-21swapper/007:17:230
3061991513,1cyclictest0-21swapper/008:45:000
3067991414,0cyclictest0-21swapper/208:42:242
306799140,14cyclictest0-21swapper/208:56:392
306799140,14cyclictest0-21swapper/207:57:292
306799140,0cyclictest0-21swapper/207:35:172
306199148,6cyclictest31953-21munin-node07:51:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional