You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 23:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Sep 22, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
232199260,25cyclictest0-21swapper/012:12:590
2333992523,1cyclictest9341-21turbostat11:15:013
233399250,24cyclictest0-21swapper/310:57:483
233399250,24cyclictest0-21swapper/310:37:163
2329992523,1cyclictest0-21swapper/212:03:392
232999250,2cyclictest30210-21ssh10:36:212
232999250,24cyclictest19473-21kernelversion11:53:022
232999250,24cyclictest13139-21ssh09:23:452
2325992522,2cyclictest9692-21rm10:47:221
232199250,24cyclictest141rcuc/010:46:340
232199250,24cyclictest0-21swapper/010:53:020
232199250,24cyclictest0-21swapper/009:17:570
2333992421,2cyclictest25086-21sh12:27:393
233399240,24cyclictest0-21swapper/311:25:543
233399240,24cyclictest0-21swapper/310:52:513
233399240,24cyclictest0-21swapper/310:41:093
233399240,23cyclictest4669-21kworker/u8:010:15:243
233399240,23cyclictest0-21swapper/311:43:483
233399240,1cyclictest6460-21diskmemload12:10:113
233399240,1cyclictest0-21swapper/312:07:003
2329992423,1cyclictest28873-21diskmemload10:22:342
2329992423,1cyclictest28873-21diskmemload09:33:502
232999240,23cyclictest7874-21rm12:12:052
232999240,23cyclictest28873-21diskmemload11:57:172
232999240,23cyclictest28873-21diskmemload09:25:502
232999240,23cyclictest0-21swapper/212:37:262
232999240,1cyclictest21488-21sh11:26:002
2325992422,1cyclictest28873-21diskmemload11:28:391
2325992421,2cyclictest20880-21grep10:00:001
232599241,22cyclictest30576-21sh09:11:451
232599240,24cyclictest0-21swapper/112:11:201
232599240,24cyclictest0-21swapper/111:40:291
232599240,23cyclictest0-21swapper/111:38:111
232599240,0cyclictest0-21swapper/110:50:021
232199242,21cyclictest19663-21sh10:55:070
2321992421,2cyclictest9345-21ssh09:20:530
232199242,0cyclictest62550irq/127-eno112:36:300
232199240,24cyclictest28873-21diskmemload09:42:350
232199240,23cyclictest0-21swapper/011:44:390
232199240,22cyclictest313-21systemd-journal08:55:010
232199240,1cyclictest62550irq/127-eno111:00:420
232199240,1cyclictest28873-21diskmemload12:04:470
2333992323,0cyclictest0-21swapper/311:47:553
2333992323,0cyclictest0-21swapper/309:49:513
233399232,21cyclictest32182-21ssh10:09:353
2333992321,1cyclictest9244-21perf08:30:003
2333992321,1cyclictest28873-21diskmemload10:47:013
2333992321,1cyclictest20884-21ssh11:53:383
2333992321,1cyclictest0-21swapper/312:20:023
2333992321,1cyclictest0-21swapper/311:57:293
233399231,21cyclictest28873-21diskmemload10:32:563
233399230,23cyclictest0-21swapper/311:37:333
233399230,23cyclictest0-21swapper/311:15:033
233399230,23cyclictest0-21swapper/309:15:593
233399230,22cyclictest4669-21kworker/u8:010:20:073
233399230,22cyclictest28873-21diskmemload12:00:423
233399230,22cyclictest28873-21diskmemload10:11:403
233399230,22cyclictest25848-21diskmemload09:35:283
233399230,22cyclictest20622-21idleruntime-cro11:25:003
233399230,22cyclictest0-21swapper/308:07:573
233399230,1cyclictest0-21swapper/309:43:113
233399230,0cyclictest28873-21diskmemload12:37:013
233399230,0cyclictest0-21swapper/309:14:163
2329992323,0cyclictest0-21swapper/211:46:312
2329992323,0cyclictest0-21swapper/211:39:022
2329992323,0cyclictest0-21swapper/209:48:232
2329992323,0cyclictest0-21swapper/209:40:192
2329992321,1cyclictest19026-21grep11:23:052
2329992320,2cyclictest16867-21munin-run07:40:002
2329992320,2cyclictest13090-21ssh11:18:042
232999230,23cyclictest0-21swapper/210:01:472
232999230,22cyclictest9367-21ssh11:43:172
232999230,22cyclictest30520-21sh11:33:092
232999230,0cyclictest28873-21diskmemload11:07:482
232999230,0cyclictest0-21swapper/210:33:382
2325992323,0cyclictest0-21swapper/111:07:391
2325992323,0cyclictest0-21swapper/110:06:231
2325992323,0cyclictest0-21swapper/109:45:251
2325992323,0cyclictest0-21swapper/109:32:271
2325992322,1cyclictest8440-21ssh11:13:451
2325992321,1cyclictest28079-21ssh12:00:371
2325992321,1cyclictest15659-21ssh09:26:511
232599231,21cyclictest25770-21apt-get10:32:561
232599230,23cyclictest0-21swapper/112:23:451
232599230,23cyclictest0-21swapper/111:15:291
232599230,23cyclictest0-21swapper/110:01:071
232599230,23cyclictest0-21swapper/109:43:121
232599230,22cyclictest28873-21diskmemload11:31:141
232599230,22cyclictest22273-21ssh11:55:151
232599230,22cyclictest0-21swapper/112:08:311
232599230,22cyclictest0-21swapper/109:19:001
232599230,1cyclictest28999-21ssh12:30:231
232599230,0cyclictest0-21swapper/111:00:341
232599230,0cyclictest0-21swapper/110:56:171
232599230,0cyclictest0-21swapper/110:29:131
232599230,0cyclictest0-21swapper/110:23:191
232599230,0cyclictest0-21swapper/110:10:211
2321992323,0cyclictest28873-21diskmemload10:30:520
2321992323,0cyclictest0-21swapper/012:27:180
2321992323,0cyclictest0-21swapper/012:20:280
2321992323,0cyclictest0-21swapper/010:41:410
2321992323,0cyclictest0-21swapper/010:25:150
2321992323,0cyclictest0-21swapper/010:20:380
2321992323,0cyclictest0-21swapper/009:46:210
2321992322,1cyclictest13-21ksoftirqd/008:50:010
2321992322,1cyclictest0-21swapper/009:12:300
2321992320,2cyclictest0-21swapper/010:15:020
232199231,21cyclictest0-21swapper/012:16:380
232199230,23cyclictest0-21swapper/009:50:550
232199230,23cyclictest0-21swapper/009:26:110
232199230,22cyclictest27255-21perf08:00:010
232199230,22cyclictest15297-21ssh11:20:090
232199230,22cyclictest1127-21sh11:37:000
232199230,22cyclictest0-21swapper/011:56:100
232199230,22cyclictest0-21swapper/011:27:250
232199230,22cyclictest0-21swapper/010:13:010
232199230,21cyclictest0-21swapper/009:32:200
232199230,1cyclictest30723-21sh12:32:540
232199230,1cyclictest28873-21diskmemload09:55:480
232199230,1cyclictest16440-21cron08:45:010
232199230,0cyclictest0-21swapper/010:00:040
2333992222,0cyclictest0-21swapper/309:29:433
2333992221,1cyclictest0-21swapper/311:31:573
2333992220,1cyclictest503-21apt-get11:07:563
233399220,22cyclictest29979-21sh11:04:143
233399220,21cyclictest8758-21ssh09:20:103
233399220,21cyclictest28825-21ssh12:30:103
233399220,21cyclictest17342-21apt-get07:42:563
233399220,21cyclictest0-21swapper/310:26:183
233399220,21cyclictest0-21swapper/309:51:123
233399220,1cyclictest20204-21sh09:30:163
2329992222,0cyclictest28873-21diskmemload09:54:432
2329992222,0cyclictest0-21swapper/211:02:352
2329992222,0cyclictest0-21swapper/210:51:262
2329992221,1cyclictest29562-21ssh09:10:322
2329992221,1cyclictest27736-21apt-get08:02:572
2329992220,1cyclictest0-21swapper/212:21:262
2329992220,1cyclictest0-21swapper/210:55:372
232999220,22cyclictest0-21swapper/212:31:492
232999220,21cyclictest3203-21ssh09:15:222
232999220,21cyclictest28873-21diskmemload09:55:192
232999220,21cyclictest27683-21ssh10:05:432
232999220,21cyclictest19778-21apt-get08:52:572
232999220,21cyclictest1601-21ssh10:11:122
232999220,21cyclictest0-21swapper/212:16:262
232999220,21cyclictest0-21swapper/210:26:592
232999220,21cyclictest0-21swapper/208:57:582
232999220,1cyclictest4731-21ssh11:10:592
232999220,1cyclictest11899-21perf07:30:002
232999220,1cyclictest0-21swapper/209:35:292
232999220,0cyclictest0-21swapper/212:27:482
232999220,0cyclictest0-21swapper/210:41:492
2325992222,0cyclictest24590-21apt-get09:02:571
2325992222,0cyclictest0-21swapper/112:26:481
2325992221,1cyclictest0-21swapper/110:35:291
2325992221,1cyclictest0-21swapper/109:36:411
2325992220,1cyclictest16129-21ssh11:21:231
232599220,22cyclictest0-21swapper/109:24:461
232599220,21cyclictest15752-21sed12:18:071
232599220,21cyclictest11344-21sh09:51:531
232599220,21cyclictest0-21swapper/110:15:381
232599220,21cyclictest0-21swapper/107:55:021
232599220,1cyclictest2044-21rm12:35:151
232599220,1cyclictest15480-21ssh11:49:001
232599220,1cyclictest11620-21cron08:35:001
232599220,1cyclictest0-21swapper/111:50:511
232599220,0cyclictest0-21swapper/110:42:181
2321992222,0cyclictest0-21swapper/011:07:230
2321992220,1cyclictest32026-21awk08:10:000
2321992220,1cyclictest0-21swapper/011:15:260
232199220,22cyclictest0-21swapper/010:08:050
232199220,22cyclictest0-21swapper/009:36:550
232199220,21cyclictest29290-21ssh10:35:110
232199220,21cyclictest24454-21latency_hist07:55:010
232199220,21cyclictest0-21swapper/011:50:370
232199220,21cyclictest0-21swapper/011:30:190
232199220,1cyclictest0-21swapper/012:05:280
232199220,1cyclictest0-21swapper/011:11:380
2333992120,0cyclictest24443-21apt-get07:55:023
2333992119,1cyclictest313-21systemd-journal08:05:013
233399210,21cyclictest0-21swapper/310:00:503
233399210,20cyclictest0-21swapper/308:37:573
233399210,20cyclictest0-21swapper/307:22:583
233399210,20cyclictest0-21swapper/307:17:563
233399210,0cyclictest0-21swapper/309:55:083
233399210,0cyclictest0-21swapper/308:12:583
2329992121,0cyclictest777-21ssh12:05:022
2329992121,0cyclictest0-21swapper/209:07:572
2329992120,1cyclictest20128-21apt-get07:47:542
2329992119,1cyclictest0-21swapper/210:46:082
232999210,20cyclictest22528-21apt-get07:52:572
232999210,20cyclictest0-21swapper/208:32:562
232999210,1cyclictest0-21swapper/210:15:442
232999210,0cyclictest0-21swapper/208:42:562
2325992121,0cyclictest0-21swapper/109:07:571
2325992120,1cyclictest22174-21apt-get08:57:581
2325992119,1cyclictest4448-21turbostat08:20:001
2325992118,2cyclictest16841-21sh07:40:001
232599210,20cyclictest12126-21apt-get08:37:571
232599210,0cyclictest7585-21apt-get07:22:581
2321992121,0cyclictest0-21swapper/008:57:570
2321992121,0cyclictest0-21swapper/008:17:580
2321992119,1cyclictest0-21swapper/007:15:010
232199210,0cyclictest9501-21perf07:25:000
2333992020,0cyclictest0-21swapper/309:07:573
2333992020,0cyclictest0-21swapper/309:02:573
2333992020,0cyclictest0-21swapper/308:57:573
2333992020,0cyclictest0-21swapper/308:32:563
2333992018,1cyclictest21688-21cron08:55:013
2329992020,0cyclictest0-21swapper/208:37:572
2329992019,1cyclictest2769-21apt-get07:12:572
2325992020,0cyclictest0-21swapper/108:42:561
2325992020,0cyclictest0-21swapper/107:45:021
2325992019,1cyclictest0-21swapper/107:30:001
2325992019,0cyclictest0-21swapper/108:02:571
232599200,20cyclictest0-21swapper/108:27:551
232599200,0cyclictest0-21swapper/107:52:571
2321992020,0cyclictest0-21swapper/008:40:010
2321992020,0cyclictest0-21swapper/008:32:560
2321992020,0cyclictest0-21swapper/007:37:560
2321992020,0cyclictest0-21swapper/007:32:560
2321992019,1cyclictest0-21swapper/007:45:020
2329991919,0cyclictest0-21swapper/207:42:562
2329991917,1cyclictest5163-21apt-get07:17:562
2329991917,1cyclictest25318-21apt-get07:57:572
2325991919,0cyclictest0-21swapper/108:52:571
2325991916,2cyclictest4678-21perf07:15:011
2321991919,0cyclictest0-21swapper/009:07:570
2321991916,2cyclictest13-21ksoftirqd/008:30:000
2325991818,0cyclictest0-21swapper/108:22:571
2325991818,0cyclictest0-21swapper/107:42:561
2333991717,0cyclictest0-21swapper/307:47:543
2333991717,0cyclictest0-21swapper/307:35:003
2333991716,0cyclictest14542-21apt-get08:42:563
2329991717,0cyclictest0-21swapper/208:12:582
2321991717,0cyclictest0-21swapper/007:27:560
2333991614,1cyclictest0-21swapper/307:55:013
2325991614,1cyclictest0-21swapper/107:20:001
232599160,0cyclictest0-21swapper/107:32:561
2321991616,0cyclictest0-21swapper/008:22:560
2333991515,0cyclictest0-21swapper/307:37:563
2333991513,1cyclictest11897-21idleruntime-cro07:30:003
2321991513,1cyclictest0-21swapper/007:45:000
2321991513,1cyclictest0-21swapper/007:17:380
233399140,14cyclictest0-21swapper/308:15:173
233399140,0cyclictest0-21swapper/308:45:523
233399140,0cyclictest0-21swapper/308:20:203
233399140,0cyclictest0-21swapper/307:10:413
232999140,14cyclictest0-21swapper/209:00:222
232999140,14cyclictest0-21swapper/208:25:172
232999140,14cyclictest0-21swapper/208:20:382
232999140,14cyclictest0-21swapper/208:05:012
232999140,14cyclictest0-21swapper/207:20:142
232999140,0cyclictest0-21swapper/208:46:272
232999140,0cyclictest0-21swapper/208:15:202
232999140,0cyclictest0-21swapper/207:31:002
232599140,14cyclictest0-21swapper/108:10:051
232599140,14cyclictest0-21swapper/108:05:101
232199140,14cyclictest0-21swapper/008:10:160
232199140,0cyclictest0-21swapper/009:01:040
232199140,0cyclictest0-21swapper/008:00:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional