You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 22:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Jul 18, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19665992721,5cyclictest25650-21sh12:13:531
19670992623,2cyclictest0-21swapper/211:54:232
1967099260,26cyclictest0-21swapper/211:43:002
1967099260,26cyclictest0-21swapper/210:35:422
1967099260,1cyclictest0-21swapper/212:15:432
1967099260,1cyclictest0-21swapper/211:59:202
19665992623,3cyclictest0-21swapper/109:13:401
1966599260,1cyclictest31173-21if_enp1s010:52:331
1966599260,1cyclictest19608-21ssh10:12:371
19662992623,2cyclictest30256-21sh09:52:490
1967299250,24cyclictest1610-21apt-get10:55:023
19670992522,3cyclictest0-21swapper/210:58:452
19670992521,3cyclictest0-21swapper/210:53:412
19670992520,4cyclictest13812-21diskmemload11:07:322
1967099250,2cyclictest2110-21apt-get07:40:022
1967099250,24cyclictest0-21swapper/211:32:092
1967099250,21cyclictest0-21swapper/210:09:272
1967099250,0cyclictest0-21swapper/212:32:302
1967099250,0cyclictest0-21swapper/209:57:042
19665992518,3cyclictest0-21swapper/111:43:191
1966599250,24cyclictest29798-21turbostat11:20:001
1966599250,24cyclictest13812-21diskmemload12:17:131
1966599250,24cyclictest13812-21diskmemload09:55:261
1966599250,24cyclictest11871-21ssh12:31:061
1966599250,20cyclictest0-21swapper/108:55:041
1966599250,1cyclictest16349-21ssh09:41:171
1966599250,0cyclictest0-21swapper/112:26:201
1966599250,0cyclictest0-21swapper/111:01:251
19662992523,1cyclictest4000-21sh10:57:300
1966299250,24cyclictest8011-21ssh11:00:220
1966299250,24cyclictest0-21swapper/010:13:530
19672992423,1cyclictest13812-21diskmemload10:04:263
19672992422,1cyclictest15177-21rm11:36:203
19672992422,1cyclictest13812-21diskmemload11:11:013
19672992422,1cyclictest0-21swapper/311:05:213
1967299240,23cyclictest0-21swapper/310:50:263
1967299240,1cyclictest0-21swapper/311:42:593
1967299240,0cyclictest13812-21diskmemload11:00:343
1967299240,0cyclictest0-21swapper/312:37:303
19670992423,1cyclictest0-21swapper/210:40:372
19670992422,2cyclictest0-21swapper/212:07:232
1967099242,21cyclictest13812-21diskmemload11:26:352
19670992421,2cyclictest0-21swapper/209:54:232
19670992420,4cyclictest20082-21apt-get07:12:302
19670992420,4cyclictest0-21swapper/209:47:402
19670992420,3cyclictest0-21swapper/212:20:292
19670992420,3cyclictest0-21swapper/210:21:532
19670992420,3cyclictest0-21swapper/209:41:532
19670992420,3cyclictest0-21swapper/209:17:282
19670992419,4cyclictest2092-21cron07:40:002
1967099240,23cyclictest0-21swapper/212:10:272
1967099240,23cyclictest0-21swapper/211:03:172
1967099240,23cyclictest0-21swapper/209:30:232
1967099240,1cyclictest13812-21diskmemload10:46:072
1967099240,0cyclictest0-21swapper/211:35:422
1967099240,0cyclictest0-21swapper/211:18:412
19665992424,0cyclictest0-21swapper/109:17:041
19665992422,2cyclictest0-21swapper/109:22:581
19665992422,1cyclictest3920-21cron11:55:011
19665992421,2cyclictest23998-21sh10:46:161
19665992421,2cyclictest15158-21ssh11:36:191
19665992420,3cyclictest0-21swapper/110:04:341
19665992419,4cyclictest29553-21apt-get10:22:281
19665992416,3cyclictest0-21swapper/111:31:041
1966599240,24cyclictest0-21swapper/112:35:451
1966599240,24cyclictest0-21swapper/111:12:231
1966599240,24cyclictest0-21swapper/109:51:501
1966599240,23cyclictest2695-21apt-get10:27:301
1966599240,23cyclictest0-21swapper/111:26:171
1966599240,23cyclictest0-21swapper/111:08:031
1966599240,23cyclictest0-21swapper/110:42:481
1966599240,21cyclictest0-21swapper/111:20:081
1966599240,20cyclictest0-21swapper/109:39:461
1966599240,1cyclictest8888-21ssh09:33:581
1966599240,1cyclictest13812-21diskmemload12:24:491
19662992424,0cyclictest0-21swapper/009:17:000
1966299240,24cyclictest13812-21diskmemload12:09:000
1966299240,24cyclictest0-21swapper/009:35:100
1966299240,23cyclictest25721-21ssh09:49:110
1966299240,23cyclictest13812-21diskmemload10:25:170
1966299240,0cyclictest13812-21diskmemload10:06:280
19672992323,0cyclictest0-21swapper/312:09:003
19672992321,1cyclictest0-21swapper/312:21:563
19672992320,2cyclictest31896-21ssh11:51:173
19672992320,2cyclictest14620-21grep10:37:353
1967299231,21cyclictest27192-21apt-get10:20:023
1967299231,21cyclictest0-21swapper/307:42:293
1967299230,2cyclictest313-21systemd-journal09:05:003
1967299230,2cyclictest22881-21ssh12:12:223
1967299230,23cyclictest0-21swapper/312:25:193
1967299230,22cyclictest23894-21ssh09:18:303
1967299230,22cyclictest18002-21ssh10:40:433
1967299230,22cyclictest1696-21/usr/sbin/munin09:27:353
1967299230,22cyclictest1384-21ssh10:25:393
1967299230,22cyclictest0-21swapper/311:47:293
1967299230,22cyclictest0-21swapper/309:35:183
1967299230,0cyclictest0-21swapper/311:58:533
1967299230,0cyclictest0-21swapper/309:33:033
1967299230,0cyclictest0-21swapper/309:21:093
19670992323,0cyclictest0-21swapper/211:20:502
19670992321,1cyclictest15029-21apt-get08:07:292
19670992320,3cyclictest0-21swapper/210:11:032
19670992320,3cyclictest0-21swapper/209:29:062
19670992320,2cyclictest8153-21awk10:02:342
19670992320,2cyclictest3787-21perf08:50:012
19670992320,2cyclictest0-21swapper/212:38:402
19670992320,2cyclictest0-21swapper/209:35:172
1967099231,1cyclictest26947-21apt-get09:22:292
1967099230,23cyclictest0-21swapper/212:25:112
1967099230,23cyclictest0-21swapper/211:46:232
1967099230,22cyclictest6715-21sh10:30:232
1967099230,0cyclictest0-21swapper/211:10:052
1967099230,0cyclictest0-21swapper/210:15:102
19665992321,1cyclictest0-21swapper/111:46:121
19665992320,3cyclictest0-21swapper/112:03:231
1966599230,22cyclictest8633-21sh11:59:001
1966599230,22cyclictest24972-21pmu-power10:17:371
1966599230,22cyclictest0-21swapper/110:30:331
1966599230,17cyclictest26061-21awk07:22:341
1966599230,0cyclictest13812-21diskmemload09:25:461
1966599230,0cyclictest0-21swapper/112:08:291
1966599230,0cyclictest0-21swapper/110:39:511
19662992323,0cyclictest13812-21diskmemload12:38:240
19662992323,0cyclictest13812-21diskmemload12:04:290
19662992323,0cyclictest13812-21diskmemload11:59:350
19662992323,0cyclictest0-21swapper/011:35:030
19662992323,0cyclictest0-21swapper/011:13:220
19662992323,0cyclictest0-21swapper/010:36:240
19662992322,1cyclictest13812-21diskmemload10:20:120
19662992321,1cyclictest4727-21ssh09:59:370
19662992321,1cyclictest2151-21munin-run07:40:000
19662992321,1cyclictest16316-21ssh09:41:140
19662992321,1cyclictest0-21swapper/011:41:170
19662992320,2cyclictest6724-21sh12:26:470
19662992320,2cyclictest30401-21diskmemload11:20:400
1966299230,23cyclictest13812-21diskmemload11:54:370
1966299230,23cyclictest13812-21diskmemload09:12:000
1966299230,23cyclictest0-21swapper/010:19:390
1966299230,23cyclictest0-21swapper/010:00:570
1966299230,22cyclictest7242-21ssh11:28:150
1966299230,22cyclictest4686-21ssh09:30:340
1966299230,22cyclictest25339-21sh09:20:080
1966299230,22cyclictest13872-21ssh11:05:440
1966299230,22cyclictest11230-21ssh12:30:070
1966299230,22cyclictest0-21swapper/010:43:230
1966299230,1cyclictest27038-21ssh12:15:310
1966299230,0cyclictest0-21swapper/012:12:010
1966299230,0cyclictest0-21swapper/010:34:360
19672992222,0cyclictest0-21swapper/312:31:213
19672992222,0cyclictest0-21swapper/312:00:573
19672992222,0cyclictest0-21swapper/310:46:393
19672992222,0cyclictest0-21swapper/310:10:403
19672992219,2cyclictest1293-21sh09:57:183
1967299220,22cyclictest0-21swapper/312:15:213
1967299220,21cyclictest26999-21sh09:50:353
1967299220,21cyclictest16344-21ssh09:41:173
1967299220,21cyclictest14564-21idleruntime-cro08:05:013
1967299220,21cyclictest0-21swapper/311:31:273
1967299220,21cyclictest0-21swapper/310:30:353
1967299220,21cyclictest0-21swapper/309:10:073
1967299220,1cyclictest26630-21df_inode11:17:323
1967299220,1cyclictest22984-21tr09:47:313
1967299220,1cyclictest0-21swapper/310:05:083
1967299220,1cyclictest0-21swapper/307:32:303
1967299220,0cyclictest13812-21diskmemload10:15:203
19670992220,2cyclictest0-21swapper/210:25:592
19670992220,1cyclictest0-21swapper/207:20:002
1967099220,21cyclictest32038-21perf07:35:002
1967099220,21cyclictest12638-21apt-get08:02:292
19665992221,0cyclictest0-21swapper/107:40:021
19665992220,1cyclictest0-21swapper/108:30:001
19665992219,3cyclictest0-21swapper/110:06:211
19665992219,2cyclictest16979-21latency_hist08:10:001
1966599220,21cyclictest0-21swapper/108:52:301
19662992222,0cyclictest0-21swapper/011:45:120
1966299220,21cyclictest29533-21chrt10:51:130
1966299220,21cyclictest24834-21sh11:15:370
1966299220,21cyclictest0-21swapper/009:25:390
1966299220,1cyclictest9254-21ssh11:30:460
1966299220,1cyclictest1235-21rm12:21:550
1966299220,0cyclictest0-21swapper/010:45:390
19672992120,1cyclictest22245-21apt-get08:22:283
19672992120,0cyclictest0-21swapper/308:07:293
19672992119,1cyclictest27035-21apt-get08:32:303
1967099210,20cyclictest0-21swapper/208:52:302
19665992121,0cyclictest0-21swapper/108:17:291
19665992120,0cyclictest5379-21apt-get07:47:291
19665992119,1cyclictest3783-21idleruntime-cro08:50:011
1966599210,0cyclictest29427-21apt-get08:37:271
19662992119,1cyclictest24396-21cron07:20:000
1966299210,0cyclictest0-21swapper/008:25:000
19672992020,0cyclictest0-21swapper/309:07:293
19672992020,0cyclictest0-21swapper/308:55:043
19672992020,0cyclictest0-21swapper/308:42:293
19672992020,0cyclictest0-21swapper/308:37:273
19672992020,0cyclictest0-21swapper/307:52:293
19670992020,0cyclictest24637-21apt-get08:27:292
19670992020,0cyclictest0-21swapper/209:02:312
19670992020,0cyclictest0-21swapper/207:47:292
19670992019,0cyclictest0-21swapper/209:07:292
1967099200,19cyclictest0-21swapper/208:42:292
1967099200,0cyclictest0-21swapper/208:55:042
19665992020,0cyclictest0-21swapper/107:25:021
19665992020,0cyclictest0-21swapper/107:12:301
1966599200,1cyclictest7772-21apt-get07:52:291
1966599200,1cyclictest13893-21grep09:10:001
19662992020,0cyclictest12638-21apt-get08:02:290
19662992020,0cyclictest11884-21apt-get09:07:290
19662992020,0cyclictest0-21swapper/007:42:290
19662992020,0cyclictest0-21swapper/007:12:300
19662992019,0cyclictest0-21swapper/008:32:300
19672991919,0cyclictest0-21swapper/307:57:293
19672991919,0cyclictest0-21swapper/307:27:273
19670991919,0cyclictest26841-21apt-get07:25:022
19670991919,0cyclictest0-21swapper/208:37:272
19670991919,0cyclictest0-21swapper/208:32:302
19670991919,0cyclictest0-21swapper/208:16:392
19670991917,1cyclictest24891-21apt-get07:22:282
19662991917,1cyclictest7339-21munin-plugin-st07:50:010
19662991917,1cyclictest16981-21perf08:10:000
1967299180,0cyclictest0-21swapper/307:47:293
19670991816,1cyclictest0-21swapper/208:00:012
19665991818,0cyclictest0-21swapper/108:42:291
19665991818,0cyclictest0-21swapper/107:17:271
19665991817,1cyclictest9438-21apt-get09:02:301
1967299173,13cyclictest32474-21apt-get07:37:283
19672991716,1cyclictest0-21swapper/308:12:313
19672991716,1cyclictest0-21swapper/307:17:273
19670991717,0cyclictest0-21swapper/207:52:282
19665991717,0cyclictest0-21swapper/107:57:281
19665991713,4cyclictest0-21swapper/108:02:371
1966599170,2cyclictest0-21swapper/107:37:281
19662991717,0cyclictest0-21swapper/008:37:270
19662991717,0cyclictest0-21swapper/007:25:020
19672991616,0cyclictest0-21swapper/308:17:293
19672991614,1cyclictest0-21swapper/307:12:303
19672991612,2cyclictest313-21systemd-journal08:55:013
1966599160,15cyclictest0-21swapper/108:32:301
19662991616,0cyclictest31848-21apt-get08:42:290
19662991616,0cyclictest0-21swapper/007:32:300
19662991614,1cyclictest0-21swapper/008:27:300
1966299160,15cyclictest0-21swapper/008:45:010
19670991515,0cyclictest0-21swapper/208:12:312
1966599150,0cyclictest0-21swapper/107:32:291
19662991515,0cyclictest0-21swapper/007:52:290
1966299150,1cyclictest5952-21users08:52:400
1967299146,7cyclictest25078-21/usr/sbin/munin08:27:303
1967299140,14cyclictest0-21swapper/307:20:103
1967099140,14cyclictest0-21swapper/208:23:122
19665991414,0cyclictest0-21swapper/108:11:161
1966599140,0cyclictest0-21swapper/108:20:271
19662991414,0cyclictest0-21swapper/008:56:290
19662991414,0cyclictest0-21swapper/008:15:110
19662991414,0cyclictest0-21swapper/007:55:450
1966299140,14cyclictest0-21swapper/009:01:070
1966299140,14cyclictest0-21swapper/008:10:340
1966299140,0cyclictest0-21swapper/007:20:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional