You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 16:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Wed Jul 22, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20934993021,4cyclictest0-21swapper/012:33:070
2093499270,26cyclictest0-21swapper/009:58:430
2093499270,1cyclictest17430-21ssh12:04:590
2093499260,2cyclictest14294-21diskmemload10:48:120
2093499260,25cyclictest24695-21ssh11:13:080
2093499260,0cyclictest0-21swapper/010:52:490
2094599250,24cyclictest0-21swapper/312:34:153
2094599250,24cyclictest0-21swapper/310:30:203
2094599250,24cyclictest0-21swapper/309:13:283
2094199250,23cyclictest313-21systemd-journal10:05:002
20936992524,1cyclictest27414-21kworker/1:210:20:101
2093699250,25cyclictest17877-21ssh12:34:151
20934992522,3cyclictest0-21swapper/010:09:110
20934992520,4cyclictest0-21swapper/010:44:450
20934992518,6cyclictest22228-21ssh09:17:400
2093499250,24cyclictest28921-21ssh12:15:510
2093499250,1cyclictest0-21swapper/009:30:250
2093499250,0cyclictest14294-21diskmemload09:36:510
20945992422,1cyclictest22477-21perf12:10:003
2094599240,23cyclictest15756-21idleruntime-cro09:40:013
2094599240,23cyclictest14294-21diskmemload09:31:133
2094599240,23cyclictest0-21swapper/312:14:153
2094599240,1cyclictest14294-21diskmemload10:19:013
2094199240,23cyclictest0-21swapper/212:13:072
2094199240,0cyclictest14294-21diskmemload12:25:222
20936992423,1cyclictest3318-21ssh10:54:321
20936992423,1cyclictest14294-21diskmemload11:43:251
20936992422,1cyclictest22483-21latency_hist12:10:001
2093699240,24cyclictest16188-21rm09:12:031
2093699240,24cyclictest14294-21diskmemload10:18:051
2093699240,24cyclictest0-21swapper/109:31:131
2093699240,23cyclictest7729-21cat10:30:011
2093699240,23cyclictest31870-21ssh09:25:261
2093699240,0cyclictest14294-21diskmemload10:04:531
2093699240,0cyclictest0-21swapper/112:17:561
20934992423,1cyclictest17713-21ssh09:42:320
20934992420,4cyclictest0-21swapper/011:32:530
20934992420,3cyclictest0-21swapper/011:37:250
20934992420,3cyclictest0-21swapper/010:29:130
20934992419,4cyclictest0-21swapper/010:31:100
2093499240,2cyclictest32039-21sh11:48:330
2093499240,23cyclictest24155-21ssh12:11:580
2093499240,23cyclictest14294-21diskmemload12:37:020
2093499240,23cyclictest0-21swapper/011:56:250
2093499240,23cyclictest0-21swapper/010:55:560
2093499240,21cyclictest0-21swapper/009:46:180
2093499240,0cyclictest14294-21diskmemload11:21:510
2093499240,0cyclictest14294-21diskmemload11:00:100
2093499240,0cyclictest0-21swapper/011:51:560
2093499240,0cyclictest0-21swapper/011:15:540
2093499240,0cyclictest0-21swapper/009:26:200
20945992323,0cyclictest14294-21diskmemload11:28:113
20945992323,0cyclictest14294-21diskmemload10:14:093
20945992323,0cyclictest0-21swapper/311:43:253
20945992323,0cyclictest0-21swapper/311:00:163
20945992322,1cyclictest14294-21diskmemload09:27:503
20945992321,1cyclictest0-21swapper/311:15:063
20945992321,1cyclictest0-21swapper/310:07:203
2094599230,23cyclictest0-21swapper/311:22:433
2094599230,22cyclictest14294-21diskmemload09:20:313
2094599230,22cyclictest0-21swapper/310:56:573
2094599230,22cyclictest0-21swapper/310:50:593
2094599230,22cyclictest0-21swapper/309:57:113
2094599230,22cyclictest0-21swapper/309:16:463
2094599230,0cyclictest14294-21diskmemload12:25:143
2094599230,0cyclictest14294-21diskmemload09:47:373
2094599230,0cyclictest0-21swapper/312:17:563
2094599230,0cyclictest0-21swapper/312:03:583
2094599230,0cyclictest0-21swapper/310:48:123
2094599230,0cyclictest0-21swapper/310:35:413
2094599230,0cyclictest0-21swapper/309:43:163
20941992323,0cyclictest14294-21diskmemload10:19:332
20941992323,0cyclictest0-21swapper/211:25:012
20941992323,0cyclictest0-21swapper/210:46:332
20941992323,0cyclictest0-21swapper/209:10:462
20941992322,1cyclictest27707-21kworker/u8:009:55:442
2094199232,20cyclictest609-21rs:main2
20941992322,0cyclictest0-21swapper/212:34:372
20941992321,1cyclictest31915-21idleruntime-cro08:40:002
20941992320,3cyclictest0-21swapper/212:00:272
20941992320,2cyclictest24814-21ssh11:42:512
20941992320,2cyclictest19450-21ssh10:40:152
2094199230,23cyclictest0-21swapper/211:36:282
2094199230,23cyclictest0-21swapper/211:08:412
2094199230,23cyclictest0-21swapper/211:00:302
2094199230,23cyclictest0-21swapper/210:07:522
2094199230,23cyclictest0-21swapper/209:47:202
2094199230,23cyclictest0-21swapper/209:24:542
2094199230,22cyclictest25976-21grep11:15:012
2094199230,22cyclictest21885-21rm10:14:072
2094199230,22cyclictest1911-21dump-pmu-power08:45:012
2094199230,22cyclictest13807-21ssh10:35:212
2094199230,22cyclictest10376-21apt-get11:30:012
2094199230,0cyclictest0-21swapper/211:50:252
2094199230,0cyclictest0-21swapper/211:46:282
2094199230,0cyclictest0-21swapper/209:17:122
20936992323,0cyclictest14294-21diskmemload10:07:181
20936992323,0cyclictest0-21swapper/112:39:111
20936992323,0cyclictest0-21swapper/111:30:081
20936992323,0cyclictest0-21swapper/111:28:111
20936992323,0cyclictest0-21swapper/111:09:311
20936992323,0cyclictest0-21swapper/110:14:091
20936992321,2cyclictest20820-21rm09:15:291
20936992321,1cyclictest32124-21ssh09:54:491
2093699230,23cyclictest0-21swapper/112:25:141
2093699230,22cyclictest24059-21sh12:11:501
2093699230,22cyclictest13909-21ssh12:02:361
2093699230,1cyclictest15754-21sendmail-msp09:40:011
2093699230,1cyclictest0-21swapper/111:46:321
2093699230,1cyclictest0-21swapper/109:57:361
2093699230,0cyclictest14294-21diskmemload11:50:101
2093699230,0cyclictest14294-21diskmemload11:04:591
2093699230,0cyclictest14294-21diskmemload10:35:391
2093699230,0cyclictest0-21swapper/111:22:181
2093699230,0cyclictest0-21swapper/109:47:371
2093699230,0cyclictest0-21swapper/109:42:171
20934992323,0cyclictest14294-21diskmemload10:10:140
20934992321,2cyclictest22942-21ssh10:15:090
20934992321,2cyclictest15725-21ssh11:06:030
20934992320,3cyclictest0-21swapper/012:06:490
2093499230,22cyclictest15012-21sh09:10:350
2093499230,22cyclictest14992-21taskset10:36:580
2093499230,22cyclictest14294-21diskmemload12:25:470
2093499230,20cyclictest0-21swapper/010:20:420
2093499230,0cyclictest14294-21diskmemload11:42:030
2093499230,0cyclictest14294-21diskmemload10:00:220
20945992222,0cyclictest0-21swapper/310:25:383
20945992220,1cyclictest2489-21diskmemload12:20:463
2094599220,22cyclictest28584-21apt-get07:27:493
2094599220,22cyclictest14294-21diskmemload11:46:193
2094599220,22cyclictest0-21swapper/311:31:443
2094599220,22cyclictest0-21swapper/310:01:283
2094599220,21cyclictest9514-21perf09:00:013
2094599220,21cyclictest18680-21sh12:35:023
2094599220,21cyclictest14294-21diskmemload11:55:083
2094599220,21cyclictest14294-21diskmemload09:50:263
2094599220,21cyclictest0-21swapper/311:10:523
2094599220,21cyclictest0-21swapper/311:05:173
2094599220,1cyclictest17467-21diskmemload11:36:163
2094599220,0cyclictest0-21swapper/311:50:103
2094599220,0cyclictest0-21swapper/310:42:063
20941992222,0cyclictest0-21swapper/209:35:052
20941992222,0cyclictest0-21swapper/209:25:132
20941992220,2cyclictest0-21swapper/209:40:062
20941992220,1cyclictest816-21df_inode10:52:512
20941992220,1cyclictest5475-21munin-run07:45:002
20941992220,1cyclictest0-21swapper/210:20:102
2094199220,2cyclictest20157-21sh12:36:572
2094199220,22cyclictest0-21swapper/212:19:562
2094199220,22cyclictest0-21swapper/211:57:592
2094199220,21cyclictest8152-21ssh10:30:172
2094199220,21cyclictest32208-21ssh11:20:342
2094199220,21cyclictest26189-21apt-get07:22:482
2094199220,21cyclictest14294-21diskmemload09:30:402
2094199220,21cyclictest0-21swapper/210:55:182
2094199220,21cyclictest0-21swapper/210:25:102
2094199220,21cyclictest0-21swapper/209:07:502
2094199220,1cyclictest31420-21diskmemload11:19:552
2094199220,1cyclictest0-21swapper/212:20:342
20936992222,0cyclictest0-21swapper/111:55:441
20936992222,0cyclictest0-21swapper/110:41:171
20936992221,1cyclictest5879-21ssh12:23:011
20936992221,1cyclictest16661-21ssh11:35:051
20936992221,1cyclictest15063-21turbostat.cron08:05:011
20936992220,2cyclictest8975-21rm10:31:191
2093699220,2cyclictest4699-21ssh10:56:071
2093699220,21cyclictest0-21swapper/107:27:491
2093699220,1cyclictest9532-21sendmail-msp09:00:011
2093699220,1cyclictest0-21swapper/111:12:271
2093699220,0cyclictest14294-21diskmemload09:23:181
20934992220,1cyclictest3540-21apt-get07:42:490
20934992220,1cyclictest31030-21apt-get07:32:470
20934992220,1cyclictest17431-21cron08:10:010
20934992220,1cyclictest0-21swapper/007:55:010
20934992219,2cyclictest313-21systemd-journal08:20:000
20934992216,0cyclictest0-21swapper/007:47:490
2093499220,22cyclictest0-21swapper/009:20:160
2093499220,21cyclictest0-21swapper/009:50:370
20945992121,0cyclictest0-21swapper/307:52:503
20945992120,1cyclictest0-21swapper/307:12:473
20945992119,1cyclictest0-21swapper/308:07:493
2094599210,20cyclictest9997-21apt-get09:02:493
2094599210,20cyclictest0-21swapper/308:47:493
20941992121,0cyclictest0-21swapper/208:32:502
20941992121,0cyclictest0-21swapper/207:17:492
20941992120,1cyclictest0-21swapper/207:37:492
2094199210,20cyclictest8329-21apt-get07:52:502
20936992121,0cyclictest10726-21apt-get07:57:521
20936992121,0cyclictest0-21swapper/107:52:501
20936992119,1cyclictest27140-21awk08:30:001
20934992121,0cyclictest0-21swapper/007:57:520
20934992118,2cyclictest23291-21ls07:15:010
2093499210,21cyclictest0-21swapper/008:27:490
20945992020,0cyclictest0-21swapper/308:02:503
20945992020,0cyclictest0-21swapper/307:17:493
20945992019,1cyclictest27127-21perf08:30:003
2094599200,20cyclictest0-21swapper/308:42:483
20941992020,0cyclictest5934-21apt-get07:47:492
20941992020,0cyclictest5181-21apt-get08:52:472
20941992018,1cyclictest503-21munin-run07:35:002
20941992018,1cyclictest0-21swapper/208:20:002
2094199200,0cyclictest2394-21apt-get08:47:492
2094199200,0cyclictest0-21swapper/208:12:492
2094199200,0cyclictest0-21swapper/207:27:492
2094199200,0cyclictest0-21swapper/207:12:472
20936992020,0cyclictest0-21swapper/107:17:491
20936992020,0cyclictest0-21swapper/107:12:471
20936992019,0cyclictest0-21swapper/108:07:491
20936992018,1cyclictest1921-21idleruntime-cro08:45:011
2093699200,0cyclictest0-21swapper/109:02:491
20934992020,0cyclictest0-21swapper/008:37:490
20934992020,0cyclictest0-21swapper/008:02:500
20934992018,1cyclictest622-21gdbus07:25:000
20941991918,1cyclictest0-21swapper/208:07:492
20936991919,0cyclictest1106-21apt-get07:37:491
20936991918,0cyclictest0-21swapper/107:47:491
20934991919,0cyclictest0-21swapper/007:37:490
20934991919,0cyclictest0-21swapper/007:27:490
20934991917,1cyclictest9531-21basename09:00:010
20945991818,0cyclictest0-21swapper/307:47:493
20945991816,1cyclictest0-21swapper/307:42:493
20936991816,1cyclictest0-21swapper/109:07:501
20934991818,0cyclictest0-21swapper/008:32:500
20934991815,2cyclictest25713-21dump-pmu-power07:20:010
20945991717,0cyclictest0-21swapper/307:57:523
20945991716,0cyclictest0-21swapper/309:07:503
20941991717,0cyclictest0-21swapper/209:02:502
20941991717,0cyclictest0-21swapper/208:57:502
20941991717,0cyclictest0-21swapper/208:27:492
20941991717,0cyclictest0-21swapper/207:57:522
20945991616,0cyclictest0-21swapper/308:32:493
20941991614,1cyclictest22806-21apt-get08:22:492
20936991616,0cyclictest27601-21apt-get08:32:491
20936991615,0cyclictest0-21swapper/107:42:491
2094199150,1cyclictest13361-21cstates08:02:512
2093499150,10cyclictest32412-21apt-get08:42:480
20945991414,0cyclictest0-21swapper/308:50:023
20945991414,0cyclictest0-21swapper/307:30:033
2094599140,14cyclictest0-21swapper/308:35:383
2094599140,14cyclictest0-21swapper/308:15:353
2094599140,14cyclictest0-21swapper/308:10:413
2094599140,14cyclictest0-21swapper/307:35:363
2094599140,14cyclictest0-21swapper/307:20:283
2094599140,0cyclictest0-21swapper/308:20:153
20936991414,0cyclictest0-21swapper/108:50:021
20936991414,0cyclictest0-21swapper/108:15:581
20936991414,0cyclictest0-21swapper/107:30:581
2093699140,14cyclictest0-21swapper/108:20:151
2093699140,14cyclictest0-21swapper/107:20:321
2093699140,0cyclictest0-21swapper/108:45:071
2093699140,0cyclictest0-21swapper/108:10:251
2093499140,14cyclictest0-21swapper/009:05:540
2093499140,14cyclictest0-21swapper/008:50:290
2093499140,14cyclictest0-21swapper/008:45:110
2093499140,14cyclictest0-21swapper/008:20:170
2093499140,14cyclictest0-21swapper/008:10:070
2093499140,0cyclictest0-21swapper/009:00:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional