You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-12 - 17:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sun Apr 12, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15774992523,1cyclictest0-21swapper/212:39:312
1577399250,24cyclictest31480-21ssh09:30:441
15775992423,1cyclictest9586-21diskmemload10:45:093
15775992422,1cyclictest0-21swapper/312:30:153
1577599240,23cyclictest9586-21diskmemload11:25:513
1577499241,1cyclictest25766-21ssh10:56:112
1577499240,23cyclictest16239-21sh09:17:042
1577499240,23cyclictest0-21swapper/211:47:512
1577399240,23cyclictest0-21swapper/110:49:251
1577399240,23cyclictest0-21swapper/109:17:521
1577399240,0cyclictest19907-21apt-get09:20:011
15772992423,1cyclictest9586-21diskmemload09:13:160
1577299240,24cyclictest0-21swapper/009:32:080
1577299240,23cyclictest9586-21diskmemload12:36:280
1577299240,23cyclictest9586-21diskmemload09:48:210
1577299240,23cyclictest10585-21ls11:20:010
1577299240,22cyclictest23556-21rm12:26:570
1577299240,0cyclictest0-21swapper/011:39:280
15775992323,0cyclictest0-21swapper/312:15:573
15775992323,0cyclictest0-21swapper/310:29:163
15775992323,0cyclictest0-21swapper/309:13:013
15775992322,1cyclictest0-21swapper/312:02:513
15775992321,1cyclictest22492-21sh10:51:373
1577599230,2cyclictest27621-21latency_hist11:45:003
1577599230,23cyclictest9586-21diskmemload12:35:373
1577599230,23cyclictest0-21swapper/311:38:573
1577599230,23cyclictest0-21swapper/310:31:343
1577599230,22cyclictest9013-21sh12:05:023
1577599230,22cyclictest720-21ssh11:06:533
1577599230,22cyclictest5374-21sh12:00:013
1577599230,22cyclictest22268-21ssh12:24:373
1577599230,22cyclictest15793-21ssh09:16:153
1577599230,22cyclictest14941-21ssh09:46:313
1577599230,0cyclictest9586-21diskmemload11:53:313
1577599230,0cyclictest0-21swapper/311:11:443
1577599230,0cyclictest0-21swapper/309:22:133
15774992323,0cyclictest0-21swapper/212:24:382
15774992323,0cyclictest0-21swapper/209:35:262
15774992322,1cyclictest9586-21diskmemload09:13:552
15774992321,1cyclictest0-21swapper/211:29:442
15774992320,3cyclictest0-21swapper/212:11:452
15774992320,2cyclictest15528-21ssh09:47:282
1577499230,23cyclictest9586-21diskmemload11:53:222
1577499230,23cyclictest0-21swapper/212:30:172
1577499230,23cyclictest0-21swapper/211:18:482
1577499230,23cyclictest0-21swapper/209:42:102
1577499230,22cyclictest3416-21ssh09:34:512
1577499230,0cyclictest9586-21diskmemload10:42:112
1577499230,0cyclictest0-21swapper/212:29:282
1577499230,0cyclictest0-21swapper/210:28:592
15773992322,0cyclictest20340-21apt-get09:54:251
15773992321,1cyclictest1248-21hddtemp_smartct10:19:261
15773992321,1cyclictest0-21swapper/112:13:181
15773992321,1cyclictest0-21swapper/109:46:101
1577399230,2cyclictest26466-21ssh09:26:181
1577399230,2cyclictest25229-21munin-plugin-st08:35:011
1577399230,23cyclictest0-21swapper/112:30:081
1577399230,23cyclictest0-21swapper/111:21:131
1577399230,22cyclictest24230-21sendmail-msp11:40:001
1577399230,22cyclictest23864-21sh12:28:021
1577399230,22cyclictest10609-21rm09:11:081
1577399230,22cyclictest10540-21ssh09:42:401
1577399230,0cyclictest0-21swapper/110:35:101
15772992323,0cyclictest9586-21diskmemload11:52:280
15772992323,0cyclictest62550irq/127-eno111:43:410
1577299232,1cyclictest26938-21ssh09:27:100
15772992321,1cyclictest0-21swapper/011:00:380
1577299230,2cyclictest8804-21munin-run12:05:010
1577299230,2cyclictest6716-21sh11:14:530
1577299230,23cyclictest0-21swapper/011:55:500
1577299230,23cyclictest0-21swapper/010:59:270
1577299230,22cyclictest2771-21munin-run07:50:010
1577299230,22cyclictest19922-21awk09:20:000
1577299230,22cyclictest15524-21diskmemload10:41:110
1577299230,1cyclictest22249-21users12:24:350
15775992220,2cyclictest15140-21apt-get08:15:023
15775992220,1cyclictest9239-21ssh09:40:373
15775992220,1cyclictest31149-21apt-get09:30:023
15775992220,1cyclictest28204-21sh11:46:163
15775992220,1cyclictest0-21swapper/311:01:093
15775992220,1cyclictest0-21swapper/310:15:013
15775992220,1cyclictest0-21swapper/309:38:453
1577599220,21cyclictest30979-21apt-get07:44:253
1577599220,21cyclictest2458-21perf10:20:013
1577599220,21cyclictest18623-21apt-get08:24:273
1577599220,21cyclictest0-21swapper/309:54:253
1577599220,21cyclictest0-21swapper/309:04:243
1577599220,1cyclictest8518-21ssh11:19:043
1577599220,1cyclictest25440-21rm10:55:023
1577599220,1cyclictest25226-21munin-run08:35:013
1577599220,0cyclictest0-21swapper/310:06:413
15774992222,0cyclictest0-21swapper/212:07:302
15774992222,0cyclictest0-21swapper/211:38:382
15774992222,0cyclictest0-21swapper/209:50:042
15774992221,1cyclictest0-21swapper/212:03:202
15774992219,2cyclictest12376-21latency_hist08:10:012
1577499220,21cyclictest7809-21apt-get09:09:262
1577499220,21cyclictest27250-21munin-run10:05:002
1577499220,21cyclictest25800-21ssh09:25:192
1577499220,21cyclictest18888-21sh10:45:522
1577499220,21cyclictest18202-21ssh11:31:582
1577499220,21cyclictest0-21swapper/210:35:522
1577499220,21cyclictest0-21swapper/209:20:062
1577499220,21cyclictest0-21swapper/207:29:272
1577499220,21cyclictest0-21swapper/207:24:242
1577499220,1cyclictest12209-21grep11:24:242
1577499220,1cyclictest10916-21ps10:34:322
1577499220,0cyclictest9586-21diskmemload11:10:112
15773992222,0cyclictest0-21swapper/112:37:061
15773992221,1cyclictest9267-21ssh10:33:111
15773992221,1cyclictest5754-21apt-get07:59:251
15773992220,1cyclictest0-21swapper/111:57:021
15773992220,1cyclictest0-21swapper/110:42:281
1577399220,22cyclictest0-21swapper/112:20:291
1577399220,22cyclictest0-21swapper/110:27:001
1577399220,21cyclictest27216-21cron10:05:001
1577399220,21cyclictest25541-21sh10:55:241
1577399220,21cyclictest0-21swapper/112:18:531
1577399220,21cyclictest0-21swapper/111:50:041
1577399220,21cyclictest0-21swapper/109:04:231
1577399220,21cyclictest0-21swapper/108:59:271
1577399220,1cyclictest9823-21sh11:19:301
1577399220,1cyclictest0-21swapper/111:44:491
1577399220,0cyclictest0-21swapper/111:04:271
15772992222,0cyclictest9586-21diskmemload10:35:160
15772992222,0cyclictest0-21swapper/012:12:450
15772992221,1cyclictest0-21swapper/010:30:260
15772992221,1cyclictest0-21swapper/010:28:420
15772992221,1cyclictest0-21swapper/009:22:150
15772992220,1cyclictest0-21swapper/012:17:230
15772992220,1cyclictest0-21swapper/010:47:460
15772992220,1cyclictest0-21swapper/009:41:390
1577299220,21cyclictest24108-21irqstats10:54:300
1577299220,21cyclictest0-21swapper/011:05:440
1577299220,21cyclictest0-21swapper/009:09:260
1577299220,21cyclictest0-21swapper/008:25:000
1577299220,21cyclictest0-21swapper/008:15:020
1577299220,1cyclictest26884-21sh12:31:440
1577299220,1cyclictest13919-21rm11:24:530
1577299220,1cyclictest0-21swapper/012:05:050
1577299220,0cyclictest0-21swapper/009:50:130
15775992121,0cyclictest0-21swapper/312:26:363
15775992121,0cyclictest0-21swapper/308:14:263
15775992120,1cyclictest0-21swapper/310:36:023
1577599210,21cyclictest20874-1kworker/u9:209:25:373
1577599210,21cyclictest0-21swapper/310:42:273
1577599210,20cyclictest0-21swapper/308:44:253
1577599210,1cyclictest18657-21ssh11:33:343
1577599210,0cyclictest0-21swapper/312:13:533
15774992121,0cyclictest0-21swapper/210:05:122
15774992121,0cyclictest0-21swapper/208:19:252
15774992120,1cyclictest2662-21ssh11:56:382
15774992119,1cyclictest2999-21apt-get08:59:272
15774992119,1cyclictest24988-21ssh11:41:562
15774992118,1cyclictest9586-21diskmemload10:52:332
1577499211,19cyclictest2389-21idleruntime-cro08:55:012
1577499210,21cyclictest0-21swapper/211:00:102
1577499210,21cyclictest0-21swapper/207:59:252
1577499210,20cyclictest23416-21apt-get08:34:252
1577499210,20cyclictest0-21swapper/208:04:262
1577499210,1cyclictest356-21ssh11:05:422
1577499210,1cyclictest16885-21sh12:19:012
1577499210,0cyclictest950-21apt-get07:49:242
15773992121,0cyclictest26016-21apt-get07:34:241
15773992121,0cyclictest0-21swapper/111:11:371
15773992121,0cyclictest0-21swapper/110:20:021
15773992121,0cyclictest0-21swapper/109:59:201
15773992120,1cyclictest0-21swapper/112:04:151
15773992120,1cyclictest0-21swapper/111:25:301
15773992120,1cyclictest0-21swapper/107:29:271
1577399210,21cyclictest9586-21diskmemload12:05:341
1577399210,21cyclictest9586-21diskmemload11:06:541
1577399210,21cyclictest0-21swapper/111:46:291
1577399210,21cyclictest0-21swapper/108:19:251
1577399210,1cyclictest774-21runrttasks08:09:351
1577399210,0cyclictest27966-21apt-get10:09:251
1577399210,0cyclictest0-21swapper/111:33:011
1577399210,0cyclictest0-21swapper/110:52:081
1577399210,0cyclictest0-21swapper/109:35:061
1577399210,0cyclictest0-21swapper/108:50:011
15772992121,0cyclictest0-21swapper/010:20:020
15772992121,0cyclictest0-21swapper/009:04:230
15772992121,0cyclictest0-21swapper/008:09:240
15772992120,1cyclictest0-21swapper/011:31:170
1577299210,21cyclictest0-21swapper/010:04:050
1577299210,21cyclictest0-21swapper/009:56:080
1577299210,0cyclictest0-21swapper/011:45:270
1577299210,0cyclictest0-21swapper/008:39:260
15775992020,0cyclictest0-21swapper/311:20:273
15775992020,0cyclictest0-21swapper/308:49:263
15775992020,0cyclictest0-21swapper/307:59:263
1577599200,20cyclictest0-21swapper/310:04:123
1577599200,20cyclictest0-21swapper/309:55:503
1577599200,0cyclictest151rcu_preempt08:30:003
1577599200,0cyclictest0-21swapper/308:39:263
15774992020,0cyclictest0-21swapper/210:22:082
15774992020,0cyclictest0-21swapper/210:14:362
15774992020,0cyclictest0-21swapper/207:40:492
1577499200,20cyclictest0-21swapper/208:14:262
15773992020,0cyclictest0-21swapper/108:54:271
15773992020,0cyclictest0-21swapper/107:49:241
15773992019,1cyclictest27626-21perf08:40:011
1577399200,20cyclictest0-21swapper/110:10:101
15772992020,0cyclictest9586-21diskmemload10:15:060
15772992020,0cyclictest0-21swapper/010:14:120
15772992019,1cyclictest0-21swapper/008:54:270
15772992017,2cyclictest4815-21sendmail09:00:000
15772992017,2cyclictest15155-21latency_hist08:15:000
15775991919,0cyclictest0-21swapper/310:21:443
15774991919,0cyclictest0-21swapper/209:55:302
15774991919,0cyclictest0-21swapper/208:29:262
15774991919,0cyclictest0-21swapper/207:19:242
15774991918,0cyclictest0-21swapper/208:44:252
15773991919,0cyclictest0-21swapper/109:09:261
15772991919,0cyclictest28225-21apt-get08:44:250
15772991919,0cyclictest18806-21apt-get07:19:240
15772991919,0cyclictest0-21swapper/007:39:260
15772991919,0cyclictest0-21swapper/007:14:250
15775991818,0cyclictest0-21swapper/307:39:263
15775991818,0cyclictest0-21swapper/307:34:243
15774991818,0cyclictest0-21swapper/208:39:262
15773991818,0cyclictest0-21swapper/107:39:261
15773991816,2cyclictest30641-21apt-config07:40:491
15775991717,0cyclictest23622-21apt-get07:29:263
15775991717,0cyclictest0-21swapper/308:59:273
1577599170,1cyclictest151rcu_preempt08:04:253
15774991717,0cyclictest0-21swapper/210:16:092
15774991715,1cyclictest313-21systemd-journal07:35:002
15773991717,0cyclictest0-21swapper/108:29:251
15773991715,1cyclictest18623-21apt-get08:24:271
15772991717,0cyclictest0-21swapper/008:34:250
15772991717,0cyclictest0-21swapper/008:29:250
15772991717,0cyclictest0-21swapper/007:54:250
1577499160,15cyclictest30351-21cut07:40:002
15773991616,0cyclictest0-21swapper/107:19:251
15773991614,1cyclictest0-21swapper/107:15:011
15772991616,0cyclictest0-21swapper/007:34:240
15775991515,0cyclictest0-21swapper/307:19:243
1577499150,14cyclictest30472sleep207:50:492
15773991515,0cyclictest0-21swapper/108:44:251
1577599140,14cyclictest0-21swapper/309:05:243
1577599140,14cyclictest0-21swapper/308:50:203
1577599140,14cyclictest0-21swapper/308:05:083
1577599140,14cyclictest0-21swapper/307:53:193
1577599140,14cyclictest0-21swapper/307:45:223
1577599140,14cyclictest0-21swapper/307:11:163
1577599140,0cyclictest0-21swapper/307:20:073
15774991414,0cyclictest0-21swapper/208:22:142
1577499140,14cyclictest0-21swapper/209:00:242
1577499140,14cyclictest0-21swapper/208:46:152
1577499140,14cyclictest0-21swapper/207:10:472
15773991414,0cyclictest0-21swapper/108:11:061
15773991414,0cyclictest0-21swapper/108:00:021
15773991414,0cyclictest0-21swapper/107:20:151
1577399140,0cyclictest0-21swapper/107:50:281
15772991414,0cyclictest0-21swapper/008:45:040
1577299140,14cyclictest0-21swapper/008:00:270
1577299140,14cyclictest0-21swapper/007:56:060
1577299140,14cyclictest0-21swapper/007:25:190
1577299140,0cyclictest0-21swapper/007:20:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional