You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-04 - 15:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sat Apr 04, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3243992726,0cyclictest0-21swapper/308:18:443
323299270,26cyclictest29044-21diskmemload09:44:520
323299270,26cyclictest15026-21ssh09:59:060
3232992623,3cyclictest0-21swapper/009:15:300
323299260,2cyclictest25914-21date10:10:010
323299260,26cyclictest0-21swapper/011:48:280
323299260,21cyclictest31341-21ssh11:18:510
3243992523,1cyclictest20904-21sh10:37:433
3243992523,1cyclictest0-21swapper/312:10:243
324399250,24cyclictest0-21swapper/312:31:303
324399250,24cyclictest0-21swapper/311:52:023
3239992521,4cyclictest0-21swapper/209:45:402
323999250,24cyclictest29044-21diskmemload10:34:102
323999250,24cyclictest0-21swapper/209:19:032
323999250,23cyclictest313-21systemd-journal07:50:012
323799250,24cyclictest15553-21ssh10:32:191
323799250,1cyclictest9848-21ssh09:53:581
3232992523,2cyclictest29044-21diskmemload09:35:370
3232992523,1cyclictest1915-21awk10:50:000
3232992522,2cyclictest62550irq/127-eno111:05:170
3232992520,4cyclictest8427-21diskstats09:53:470
323299250,24cyclictest29044-21diskmemload10:17:450
323299250,24cyclictest0-21swapper/012:00:290
323299250,21cyclictest29044-21diskmemload10:25:060
323299250,1cyclictest11783-21ssh12:34:180
3243992423,1cyclictest29044-21diskmemload10:31:553
3243992423,1cyclictest0-21swapper/311:47:383
324399240,24cyclictest0-21swapper/311:42:383
324399240,23cyclictest29044-21diskmemload11:04:093
324399240,23cyclictest29044-21diskmemload09:28:473
324399240,23cyclictest0-21swapper/312:17:353
3239992423,1cyclictest0-21swapper/209:41:562
3239992422,1cyclictest0-21swapper/209:23:512
323999240,23cyclictest18377-21ssh09:31:132
323999240,23cyclictest0-21swapper/212:16:492
3237992422,2cyclictest14330-21ssh12:38:071
323799240,23cyclictest609-21rs:main1
323799240,0cyclictest29044-21diskmemload12:04:531
323799240,0cyclictest0-21swapper/111:07:571
3232992422,2cyclictest0-21swapper/011:57:120
3232992420,3cyclictest0-21swapper/010:37:400
3232992420,1cyclictest29044-21diskmemload11:54:230
3232992420,0cyclictest29044-21diskmemload10:43:160
3232992420,0cyclictest0-21swapper/012:35:420
3232992420,0cyclictest0-21swapper/012:22:120
3232992420,0cyclictest0-21swapper/011:25:110
3232992419,1cyclictest2401-21ssh09:48:060
323299240,24cyclictest0-21swapper/012:19:110
323299240,24cyclictest0-21swapper/012:11:320
323299240,24cyclictest0-21swapper/010:58:460
323299240,24cyclictest0-21swapper/010:51:210
323299240,24cyclictest0-21swapper/010:34:440
323299240,23cyclictest0-21swapper/009:11:380
323299240,20cyclictest29044-21diskmemload11:14:510
323299240,1cyclictest29044-21diskmemload09:31:180
323299240,0cyclictest0-21swapper/012:05:040
3243992323,0cyclictest29044-21diskmemload11:57:273
3243992323,0cyclictest29044-21diskmemload10:02:383
3243992323,0cyclictest0-21swapper/310:14:033
3243992323,0cyclictest0-21swapper/309:22:123
3243992322,1cyclictest6569-21ssh11:26:083
3243992322,1cyclictest0-21swapper/310:59:063
3243992321,1cyclictest23971-21ssh09:37:033
3243992321,1cyclictest0-21swapper/311:30:243
3243992321,1cyclictest0-21swapper/310:51:253
3243992321,1cyclictest0-21swapper/309:12:023
324399230,23cyclictest0-21swapper/310:05:053
324399230,23cyclictest0-21swapper/309:41:543
324399230,22cyclictest5993-21sh10:23:153
324399230,22cyclictest2990-21sh09:15:573
324399230,22cyclictest29044-21diskmemload12:05:153
324399230,1cyclictest0-21swapper/309:46:033
324399230,0cyclictest29044-21diskmemload09:34:013
324399230,0cyclictest0-21swapper/311:12:133
3239992323,0cyclictest29044-21diskmemload09:27:212
3239992323,0cyclictest0-21swapper/211:55:502
3239992323,0cyclictest0-21swapper/211:34:162
3239992323,0cyclictest0-21swapper/211:13:432
3239992323,0cyclictest0-21swapper/210:06:162
3239992321,1cyclictest0-21swapper/210:19:062
3239992321,1cyclictest0-21swapper/209:57:512
3239992320,2cyclictest2509-21ssh10:50:402
3239992319,0cyclictest0-21swapper/209:50:062
323999230,23cyclictest0-21swapper/211:49:172
323999230,23cyclictest0-21swapper/211:25:272
323999230,22cyclictest4011-21ssh10:20:052
323999230,22cyclictest31636-21ssh11:50:322
323999230,22cyclictest31605-21ssh12:23:162
323999230,22cyclictest20114-21ssh12:11:152
323999230,22cyclictest10733-21head12:33:492
323999230,22cyclictest0-21swapper/211:44:352
323999230,1cyclictest0-21swapper/211:00:112
323999230,0cyclictest29044-21diskmemload12:07:172
323999230,0cyclictest0-21swapper/211:36:462
3237992323,0cyclictest29044-21diskmemload09:32:181
3237992323,0cyclictest0-21swapper/110:37:231
3237992323,0cyclictest0-21swapper/110:06:361
3237992323,0cyclictest0-21swapper/109:25:011
3237992323,0cyclictest0-21swapper/109:11:441
3237992322,1cyclictest29044-21diskmemload11:27:571
3237992321,1cyclictest752-21grep11:20:011
3237992321,1cyclictest317-21sh11:52:221
3237992321,1cyclictest0-21swapper/111:38:191
3237992320,2cyclictest3384-21diskmemload12:26:551
323799230,23cyclictest0-21swapper/112:10:391
323799230,23cyclictest0-21swapper/110:26:021
323799230,23cyclictest0-21swapper/110:14:131
323799230,22cyclictest8726-21ssh12:32:141
323799230,22cyclictest6095-21ssh10:23:241
323799230,22cyclictest2605-21ssh09:48:241
323799230,22cyclictest25106-21sh12:16:031
323799230,22cyclictest12602-21ssh11:00:201
323799230,22cyclictest0-21swapper/112:23:221
323799230,0cyclictest0-21swapper/109:37:491
3232992323,0cyclictest0-21swapper/012:29:480
3232992320,0cyclictest29044-21diskmemload10:21:500
3232992318,1cyclictest14303-21ssh09:27:590
323299230,2cyclictest8529-21ssh09:21:480
323299230,2cyclictest16420-21sh10:00:530
323299230,23cyclictest0-21swapper/011:35:460
323299230,23cyclictest0-21swapper/011:20:180
323299230,0cyclictest0-21swapper/011:40:490
3243992222,0cyclictest29044-21diskmemload12:35:203
3243992222,0cyclictest0-21swapper/312:27:433
3243992222,0cyclictest0-21swapper/312:20:333
3243992222,0cyclictest0-21swapper/312:03:033
3243992221,1cyclictest29044-21diskmemload11:05:143
3243992220,1cyclictest331rcuc/308:03:453
3243992220,1cyclictest0-21swapper/311:24:193
3243992220,1cyclictest0-21swapper/310:40:393
3243992220,1cyclictest0-21swapper/309:05:003
3243992219,2cyclictest28098-21sh11:15:053
3243992219,2cyclictest10458-21latency_hist07:25:003
324399220,22cyclictest0-21swapper/311:35:573
324399220,21cyclictest0-21swapper/310:48:253
324399220,21cyclictest0-21swapper/310:15:473
324399220,21cyclictest0-21swapper/309:57:483
324399220,21cyclictest0-21swapper/309:50:293
324399220,1cyclictest0-21swapper/310:25:143
3239992222,0cyclictest0-21swapper/211:19:292
3239992222,0cyclictest0-21swapper/210:35:442
3239992220,1cyclictest16486-21ssh10:00:592
3239992219,2cyclictest24963-21idleruntime-cro07:55:012
323999220,2cyclictest5252-21ssh11:24:232
323999220,22cyclictest14346-21ssh12:38:092
323999220,22cyclictest0-21swapper/211:05:362
323999220,21cyclictest26461-21ssh10:10:332
323999220,21cyclictest16675-21awk08:45:012
323999220,21cyclictest0-21swapper/212:25:302
323999220,21cyclictest0-21swapper/212:00:222
323999220,21cyclictest0-21swapper/208:33:462
323999220,1cyclictest7339-21rm10:55:022
323999220,1cyclictest13409-21ssh10:29:102
323999220,1cyclictest0-21swapper/210:45:002
3237992222,0cyclictest0-21swapper/111:20:151
3237992222,0cyclictest0-21swapper/109:57:191
3237992222,0cyclictest0-21swapper/109:43:331
3237992222,0cyclictest0-21swapper/109:16:041
3237992221,1cyclictest26826-21ssh11:45:521
3237992220,1cyclictest17876-21sh10:03:121
323799220,22cyclictest29044-21diskmemload12:05:471
323799220,21cyclictest2259-21ssh10:50:101
323799220,21cyclictest0-21swapper/111:33:491
323799220,21cyclictest0-21swapper/110:55:291
323799220,21cyclictest0-21swapper/107:35:001
323799220,21cyclictest0-21swapper/107:18:451
323799220,1cyclictest8825-21sh09:22:211
323799220,1cyclictest3174-21ssh10:19:161
323799220,1cyclictest30508-21ssh10:46:451
323799220,1cyclictest29760-21perf08:05:001
323799220,0cyclictest0-21swapper/111:56:111
323799220,0cyclictest0-21swapper/110:42:341
3232992221,1cyclictest0-21swapper/007:33:450
3232992220,1cyclictest32702-21apt-get08:13:460
3232992220,1cyclictest0-21swapper/010:10:340
323299220,21cyclictest17218-21apt-get08:48:440
323299220,21cyclictest0-21swapper/007:58:450
323299220,1cyclictest12182-21sh11:32:010
3243992121,0cyclictest0-21swapper/307:58:453
324399210,21cyclictest0-21swapper/309:08:463
3239992121,0cyclictest29044-21diskmemload09:36:192
3239992121,0cyclictest0-21swapper/208:28:452
3239992120,0cyclictest24820-21apt-get09:03:452
323999210,0cyclictest30308-21apt-get08:08:452
3237992120,1cyclictest29044-21diskmemload11:10:031
323799210,20cyclictest8611-21apt-get07:23:451
323799210,20cyclictest0-21swapper/108:28:451
323799210,0cyclictest0-21swapper/111:40:551
323799210,0cyclictest0-21swapper/107:28:441
3232992120,1cyclictest11007-21apt-get07:28:450
3232992120,0cyclictest0-21swapper/009:08:460
3232992119,1cyclictest606-21dbus-daemon09:00:000
3243992020,0cyclictest0-21swapper/308:53:443
3243992020,0cyclictest0-21swapper/308:28:453
3243992018,1cyclictest22575-21munin-run07:50:013
324399200,0cyclictest0-21swapper/307:53:453
3239992020,0cyclictest0-21swapper/208:39:502
3239992020,0cyclictest0-21swapper/207:28:442
3239992020,0cyclictest0-21swapper/207:18:452
3239992019,1cyclictest27915-21apt-get08:03:452
323999200,0cyclictest0-21swapper/208:18:442
3237992020,0cyclictest5167-21apt-get08:23:451
3237992020,0cyclictest0-21swapper/108:18:441
3237992020,0cyclictest0-21swapper/107:13:461
3232992020,0cyclictest0-21swapper/008:38:450
3232992020,0cyclictest0-21swapper/007:13:460
323299200,20cyclictest0-21swapper/008:53:440
323299200,0cyclictest0-21swapper/007:53:450
3243991919,0cyclictest0-21swapper/308:48:443
3243991918,1cyclictest18322-21apt-get07:43:463
3243991918,1cyclictest0-21swapper/308:38:453
3243991917,1cyclictest0-21swapper/308:08:453
3239991919,0cyclictest0-21swapper/208:53:442
3239991919,0cyclictest0-21swapper/208:23:442
3239991918,1cyclictest25502-21apt-get07:58:452
3237991919,0cyclictest0-21swapper/108:48:451
3237991919,0cyclictest0-21swapper/108:08:451
3237991919,0cyclictest0-21swapper/107:48:451
3237991918,1cyclictest26676-21ls09:05:001
3232991919,0cyclictest0-21swapper/008:08:450
3232991919,0cyclictest0-21swapper/007:48:450
3243991818,0cyclictest0-21swapper/308:58:443
3239991818,0cyclictest13404-21apt-get07:33:452
3239991818,0cyclictest0-21swapper/208:48:452
3237991817,0cyclictest19612-21apt-get08:53:441
3232991818,0cyclictest0-21swapper/008:43:460
3232991818,0cyclictest0-21swapper/008:33:460
3239991717,0cyclictest3744-21apt-get07:13:462
3237991717,0cyclictest14823-21apt-get08:43:461
3237991717,0cyclictest0-21swapper/108:58:441
3232991717,0cyclictest0-21swapper/007:38:450
3243991614,1cyclictest0-21swapper/308:45:013
324399160,15cyclictest9960-21apt-get08:33:463
323999160,15cyclictest0-21swapper/207:43:462
3237991616,0cyclictest0-21swapper/107:43:461
3232991616,0cyclictest7561-21apt-get08:28:450
3243991515,0cyclictest0-21swapper/307:28:443
3243991515,0cyclictest0-21swapper/307:13:463
3239991515,0cyclictest0-21swapper/207:23:452
3237991515,0cyclictest0-21swapper/107:52:131
3237991513,1cyclictest27351-21apt08:00:011
3232991515,0cyclictest0-21swapper/008:03:450
323299150,1cyclictest26350-21sed09:03:540
324399140,14cyclictest0-21swapper/307:37:253
324399140,0cyclictest0-21swapper/308:10:423
324399140,0cyclictest0-21swapper/307:30:133
324399140,0cyclictest0-21swapper/307:15:153
3239991414,0cyclictest0-21swapper/208:55:162
323999140,14cyclictest0-21swapper/209:05:412
323999140,14cyclictest0-21swapper/208:10:552
323999140,0cyclictest0-21swapper/207:35:282
3237991414,0cyclictest0-21swapper/107:35:041
323799140,14cyclictest0-21swapper/109:05:011
323799140,0cyclictest0-21swapper/108:35:281
3232991414,0cyclictest0-21swapper/008:15:140
3232991414,0cyclictest0-21swapper/007:15:110
323299140,14cyclictest0-21swapper/007:22:140
323299140,0cyclictest0-21swapper/008:21:580
323299140,0cyclictest0-21swapper/007:40:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional