You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 22:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Thu Jun 11, 2026 12:44:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
932999260,0cyclictest0-21swapper/308:09:253
932999250,24cyclictest3065-21diskmemload11:00:033
932999250,24cyclictest3065-21diskmemload10:48:363
9327992523,1cyclictest0-21swapper/210:53:432
9327992523,1cyclictest0-21swapper/209:23:282
932799251,23cyclictest25312-21ssh09:30:292
932799250,24cyclictest2524-21ssh12:12:372
932799250,24cyclictest1584-21kworker/u8:212:22:232
932799250,24cyclictest0-21swapper/210:04:012
932799250,1cyclictest17362-21ssh11:55:532
932299250,1cyclictest0-21swapper/112:20:271
931999250,24cyclictest0-21swapper/010:00:180
931999250,24cyclictest0-21swapper/009:40:230
9329992422,1cyclictest0-21swapper/310:15:013
9329992421,2cyclictest7425-21ssh11:46:453
932999240,23cyclictest3065-21diskmemload11:08:333
932999240,23cyclictest3065-21diskmemload09:33:413
932999240,23cyclictest0-21swapper/312:33:133
932999240,22cyclictest16775-21sh09:23:353
932999240,1cyclictest29387-21ssh12:07:113
932799240,24cyclictest0-21swapper/209:26:052
932799240,23cyclictest605-21avahi-daemon11:35:012
932799240,23cyclictest3065-21diskmemload10:27:002
932799240,1cyclictest30385-21ssh11:08:192
9322992423,0cyclictest3065-21diskmemload09:48:581
9322992421,2cyclictest29475-21ssh11:37:111
932299240,23cyclictest27584-21apt-get10:04:251
932299240,23cyclictest25781-21apt-get11:04:271
932299240,23cyclictest0-21swapper/109:26:251
932299240,1cyclictest23912-21ssh12:02:421
932299240,1cyclictest0-21swapper/109:39:471
932299240,0cyclictest0-21swapper/112:11:301
9319992421,2cyclictest29167-21ssh10:35:570
9319992421,2cyclictest0-21swapper/012:12:080
931999240,24cyclictest0-21swapper/009:16:510
931999240,23cyclictest3065-21diskmemload12:16:090
931999240,23cyclictest3065-21diskmemload11:53:070
9329992323,0cyclictest0-21swapper/311:11:493
9329992323,0cyclictest0-21swapper/310:19:023
9329992323,0cyclictest0-21swapper/309:51:353
9329992321,1cyclictest0-21swapper/310:53:283
9329992320,2cyclictest31058-21sh09:36:043
9329992320,2cyclictest1274-21perf10:40:003
932999230,2cyclictest5975-21sh09:14:093
932999230,23cyclictest0-21swapper/312:37:163
932999230,23cyclictest0-21swapper/310:03:173
932999230,23cyclictest0-21swapper/309:40:203
932999230,22cyclictest11064-21ssh09:48:523
932999230,0cyclictest3065-21diskmemload10:23:003
932999230,0cyclictest0-21swapper/309:29:083
9327992323,0cyclictest0-21swapper/209:11:442
9327992322,1cyclictest3065-21diskmemload11:04:272
9327992321,1cyclictest24454-21apt-get07:44:262
9327992321,1cyclictest0-21swapper/211:45:052
9327992321,1cyclictest0-21swapper/211:15:232
9327992321,1cyclictest0-21swapper/210:36:102
9327992320,0cyclictest0-21swapper/212:17:402
9327992319,4cyclictest0-21swapper/211:27:562
9327992318,4cyclictest0-21swapper/209:49:142
932799230,2cyclictest10115-21expr10:49:272
932799230,23cyclictest0-21swapper/212:27:242
932799230,23cyclictest0-21swapper/211:39:302
932799230,23cyclictest0-21swapper/209:53:102
932799230,22cyclictest3676-21rm09:40:382
932799230,22cyclictest3065-21diskmemload10:13:412
932799230,22cyclictest17597-21ssh10:55:082
932799230,0cyclictest1115-21ssh11:40:152
932799230,0cyclictest0-21swapper/210:05:292
9322992323,0cyclictest0-21swapper/112:28:251
9322992323,0cyclictest0-21swapper/109:12:301
9322992322,1cyclictest0-21swapper/112:30:221
9322992321,1cyclictest0-21swapper/111:44:271
9322992321,1cyclictest0-21swapper/109:55:491
9322992321,1cyclictest0-21swapper/109:31:261
9322992321,1cyclictest0-21swapper/107:20:001
932299230,23cyclictest0-21swapper/111:17:571
932299230,23cyclictest0-21swapper/109:40:291
932299230,22cyclictest8590-21ssh11:48:311
932299230,22cyclictest6369-21gltestperf10:14:291
932299230,22cyclictest32348-21basename12:40:011
932299230,22cyclictest25891-21awk08:50:001
932299230,22cyclictest18950-21perf07:30:001
932299230,22cyclictest18341-21sh11:57:121
932299230,22cyclictest1589-21ssh11:10:441
932299230,22cyclictest0-21swapper/112:15:011
932299230,22cyclictest0-21swapper/110:48:071
932299230,0cyclictest0-21swapper/110:05:181
932299230,0cyclictest0-21swapper/109:52:231
9319992323,0cyclictest3065-21diskmemload10:22:510
9319992323,0cyclictest3065-21diskmemload09:12:320
9319992323,0cyclictest0-21swapper/012:21:580
9319992323,0cyclictest0-21swapper/011:23:060
9319992323,0cyclictest0-21swapper/010:12:420
9319992321,1cyclictest11415-21sh11:19:590
9319992321,1cyclictest0-21swapper/012:35:400
9319992321,1cyclictest0-21swapper/011:26:290
9319992321,1cyclictest0-21swapper/009:31:030
9319992320,2cyclictest22591-21ssh12:30:410
931999230,2cyclictest30230-21ssh11:08:070
931999230,2cyclictest19836-21ssh10:58:340
931999230,23cyclictest0-21swapper/012:02:310
931999230,23cyclictest0-21swapper/009:29:170
931999230,22cyclictest306-21ssh12:09:450
931999230,22cyclictest29639-21apt-get07:54:260
931999230,22cyclictest1069-21sh11:10:020
931999230,22cyclictest0-21swapper/010:40:510
931999230,22cyclictest0-21swapper/009:45:420
931999230,1cyclictest0-21swapper/011:39:160
931999230,0cyclictest3065-21diskmemload11:55:470
931999230,0cyclictest0-21swapper/010:31:560
9329992222,0cyclictest0-21swapper/312:01:033
9329992222,0cyclictest0-21swapper/311:55:243
9329992222,0cyclictest0-21swapper/310:07:403
9329992222,0cyclictest0-21swapper/309:57:263
9329992221,1cyclictest12239-21ssh12:21:203
9329992220,1cyclictest16923-21ssh12:25:113
932999220,22cyclictest9493-21ssh09:16:243
932999220,22cyclictest0-21swapper/311:30:133
932999220,22cyclictest0-21swapper/311:15:403
932999220,21cyclictest23395-21sh10:30:133
932999220,21cyclictest12045-21apt-get08:24:253
932999220,1cyclictest783-21snmpd11:35:213
932999220,1cyclictest19580-21sh10:27:353
932999220,1cyclictest19451-21ssh10:58:033
932999220,1cyclictest13765-21ssh11:53:263
932999220,1cyclictest1083-21ssh12:10:243
932999220,1cyclictest0-21swapper/308:15:023
932999220,0cyclictest3065-21diskmemload10:41:143
932999220,0cyclictest0-21swapper/311:26:233
9327992222,0cyclictest0-21swapper/212:34:092
9327992222,0cyclictest0-21swapper/210:16:142
9327992221,1cyclictest9387-21ssh09:16:152
9327992221,1cyclictest0-21swapper/212:09:192
9327992220,1cyclictest0-21swapper/211:50:522
9327992220,1cyclictest0-21swapper/211:14:272
932799220,22cyclictest0-21swapper/212:37:242
932799220,22cyclictest0-21swapper/210:20:212
932799220,21cyclictest313-21systemd-journal08:15:002
932799220,21cyclictest1446-21sendmail-msp08:00:002
932799220,21cyclictest13078-21ssh11:22:032
932799220,21cyclictest0-21swapper/210:31:172
932799220,1cyclictest22766-21ssh12:00:532
932799220,1cyclictest1992-21sh10:40:462
9322992222,0cyclictest3065-21diskmemload09:15:341
9322992222,0cyclictest0-21swapper/112:06:101
9322992222,0cyclictest0-21swapper/111:52:381
9322992222,0cyclictest0-21swapper/111:05:271
9322992222,0cyclictest0-21swapper/109:21:291
9322992221,1cyclictest26492-21apt-get08:54:261
9322992221,1cyclictest0-21swapper/111:20:431
9322992221,0cyclictest8636-21apt-get08:15:021
9322992220,1cyclictest23859-21perf07:40:011
932299220,22cyclictest3065-21diskmemload10:26:141
932299220,22cyclictest0-21swapper/110:56:421
932299220,22cyclictest0-21swapper/110:30:291
932299220,21cyclictest3065-21diskmemload10:20:061
932299220,21cyclictest0-21swapper/110:15:281
932299220,21cyclictest0-21swapper/108:59:261
932299220,21cyclictest0-21swapper/108:34:271
932299220,1cyclictest23223-21sh11:30:401
932299220,1cyclictest21701-21apt-get08:44:251
9319992222,0cyclictest3065-21diskmemload09:22:390
9319992222,0cyclictest0-21swapper/012:27:520
9319992222,0cyclictest0-21swapper/011:48:280
9319992222,0cyclictest0-21swapper/010:17:430
9319992222,0cyclictest0-21swapper/009:35:200
9319992221,1cyclictest3065-21diskmemload11:00:280
9319992221,1cyclictest0-21swapper/010:46:350
9319992221,0cyclictest0-21swapper/007:19:330
931999222,0cyclictest62550irq/127-eno111:30:200
931999220,21cyclictest12433-21ssh10:50:290
931999220,1cyclictest313-21systemd-journal09:10:000
931999220,1cyclictest0-21swapper/011:41:340
931999220,0cyclictest0-21swapper/010:09:430
9329992120,0cyclictest0-21swapper/308:29:263
9329992120,0cyclictest0-21swapper/307:50:023
9329992119,1cyclictest8643-21munin-run08:15:003
932999210,20cyclictest19540-21apt-get07:34:253
932999210,1cyclictest3097-21awk09:10:003
9327992120,1cyclictest0-21swapper/208:44:252
932799210,1cyclictest31871-21ssh09:37:192
932799210,0cyclictest3065-21diskmemload09:55:282
932799210,0cyclictest0-21swapper/208:54:262
9322992121,0cyclictest0-21swapper/110:50:481
9322992121,0cyclictest0-21swapper/108:24:251
9322992121,0cyclictest0-21swapper/107:14:251
9322992119,1cyclictest4434-21apt-get08:09:251
932299210,20cyclictest0-21swapper/110:35:011
932299210,0cyclictest0-21swapper/108:04:251
9319992121,0cyclictest3065-21diskmemload10:26:280
9319992119,1cyclictest0-21swapper/008:55:000
9319992118,2cyclictest21099-21turbostat.cron08:40:010
931999210,0cyclictest0-21swapper/008:59:270
931999210,0cyclictest0-21swapper/008:44:250
931999210,0cyclictest0-21swapper/008:29:260
931999210,0cyclictest0-21swapper/007:14:260
9329992020,0cyclictest9880-21apt-get07:14:263
9329992020,0cyclictest21701-21apt-get08:44:253
932999200,0cyclictest0-21swapper/307:29:253
9327992020,0cyclictest0-21swapper/207:54:262
9327992017,2cyclictest672-21idleruntime-cro09:05:002
932799200,0cyclictest0-21swapper/208:35:012
9322992020,0cyclictest0-21swapper/108:39:261
9322992018,1cyclictest31416-21idleruntime-cro07:55:011
9319992020,0cyclictest0-21swapper/008:24:250
9319992020,0cyclictest0-21swapper/007:59:260
931999200,0cyclictest0-21swapper/007:49:270
931999200,0cyclictest0-21swapper/007:39:260
9327991919,0cyclictest0-21swapper/207:49:272
9327991917,1cyclictest18954-21munin-run07:30:002
9327991917,1cyclictest0-21swapper/208:20:002
9319991919,0cyclictest0-21swapper/008:49:260
9319991919,0cyclictest0-21swapper/008:09:250
9319991919,0cyclictest0-21swapper/008:05:000
9319991918,1cyclictest9629-21apt-get08:19:260
9329991818,0cyclictest0-21swapper/307:39:253
9329991817,1cyclictest28292-21perf08:55:003
9329991817,1cyclictest26849-21apt-get07:49:273
9329991817,1cyclictest12276-21apt-get07:19:243
9329991816,1cyclictest0-21swapper/309:05:003
9329991816,1cyclictest0-21swapper/308:05:003
9327991818,0cyclictest0-21swapper/207:24:242
9327991817,1cyclictest2039-21apt-get08:04:252
9322991818,0cyclictest0-21swapper/109:09:261
9322991818,0cyclictest0-21swapper/109:04:271
9322991818,0cyclictest0-21swapper/107:59:261
9319991818,0cyclictest0-21swapper/007:34:250
9319991817,1cyclictest31302-21apt-get09:04:270
9329991717,0cyclictest0-21swapper/308:59:273
9329991717,0cyclictest0-21swapper/308:39:273
9329991715,1cyclictest1397-21idleruntime-cro08:00:003
9327991717,0cyclictest28886-21apt-get08:59:272
9322991717,0cyclictest0-21swapper/108:29:261
9319991717,0cyclictest6828-21apt-get08:14:250
9329991616,0cyclictest14693-21apt-get07:24:243
9329991612,2cyclictest17442-21perl08:34:293
9327991616,0cyclictest0-21swapper/209:09:262
9327991614,1cyclictest21310-21cron07:35:012
932799160,14cyclictest0-21swapper/207:37:022
9322991614,1cyclictest211rcuc/108:15:011
9319991616,0cyclictest0-21swapper/007:29:250
9319991615,0cyclictest0-21swapper/008:34:270
9327991515,0cyclictest14441-21apt-get08:29:262
9327991515,0cyclictest0-21swapper/208:39:262
9327991515,0cyclictest0-21swapper/208:24:252
9327991515,0cyclictest0-21swapper/208:09:252
932799150,15cyclictest0-21swapper/207:19:372
9322991515,0cyclictest0-21swapper/107:44:261
932999140,14cyclictest0-21swapper/308:45:473
932999140,14cyclictest0-21swapper/307:41:063
932799140,14cyclictest0-21swapper/208:47:362
932799140,14cyclictest0-21swapper/207:10:382
9322991414,0cyclictest0-21swapper/107:30:261
932299140,0cyclictest0-21swapper/107:20:301
931999140,14cyclictest0-21swapper/007:21:180
931999140,0cyclictest0-21swapper/007:40:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional