You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 14:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Thu Aug 06, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7815210289,9sleep20-21swapper/207:08:522
720028875,9sleep30-21swapper/307:05:253
778028644,38sleep00-21swapper/007:08:260
788227861,13sleep10-21swapper/107:09:441
799799280,28cyclictest0-21swapper/212:33:002
799799280,27cyclictest0-21swapper/212:38:172
799799280,27cyclictest0-21swapper/212:38:172
799799250,24cyclictest0-21swapper/212:12:202
7994992524,1cyclictest0-21swapper/111:57:351
799799240,24cyclictest0-21swapper/212:23:502
799799240,23cyclictest0-21swapper/212:25:002
799799240,0cyclictest0-21swapper/210:17:582
8001992316,4cyclictest39-21ksoftirqd/311:55:133
799499231,18cyclictest0-21swapper/108:25:131
799499230,2cyclictest0-21swapper/111:40:281
799299230,0cyclictest0-21swapper/012:21:020
799299230,0cyclictest0-21swapper/010:01:530
800199213,2cyclictest0-21swapper/310:53:413
799799210,21cyclictest0-21swapper/210:20:262
799799210,21cyclictest0-21swapper/210:10:002
800199200,20cyclictest0-21swapper/312:13:423
799799202,16cyclictest0-21swapper/209:38:362
7997992019,1cyclictest0-21swapper/212:18:192
799799200,20cyclictest0-21swapper/211:30:352
799799200,20cyclictest0-21swapper/210:33:512
799799200,15cyclictest0-21swapper/212:00:142
799499204,9cyclictest12679-21ssh12:30:121
799499200,3cyclictest0-21swapper/112:37:421
799499200,3cyclictest0-21swapper/112:37:411
799299200,1cyclictest0-21swapper/010:26:270
799799191,18cyclictest0-21swapper/210:43:072
799799190,19cyclictest0-21swapper/209:54:122
799799190,18cyclictest0-21swapper/210:37:432
799799190,18cyclictest0-21swapper/209:22:572
7994991917,1cyclictest0-21swapper/109:15:031
799499190,18cyclictest0-21swapper/107:10:131
799299190,3cyclictest0-21swapper/009:21:350
799299190,17cyclictest0-21swapper/012:03:270
799799184,5cyclictest225-21systemd-journal11:07:522
799799180,17cyclictest0-21swapper/209:40:082
799499180,17cyclictest0-21swapper/110:54:031
799499180,17cyclictest0-21swapper/109:14:151
7992991818,0cyclictest0-21swapper/010:13:440
799299180,3cyclictest0-21swapper/011:26:050
800199174,8cyclictest12773-21timerwakeupswit09:35:263
799799171,15cyclictest26281-21perf08:55:002
799799170,16cyclictest0-21swapper/210:12:392
799499170,16cyclictest0-21swapper/107:40:111
7992991716,1cyclictest0-21swapper/010:07:530
799299170,13cyclictest0-21swapper/007:50:020
8001991612,1cyclictest39-21ksoftirqd/310:32:393
800199160,1cyclictest141rcu_preempt11:31:473
799799167,4cyclictest225-21systemd-journal07:45:502
7997991615,1cyclictest0-21swapper/207:55:002
799799160,14cyclictest0-21swapper/211:25:192
799499167,4cyclictest4551-21sshd09:30:301
7992991611,2cyclictest537-21snmpd11:07:520
799299160,1cyclictest0-21swapper/012:15:480
799299160,1cyclictest0-21swapper/011:30:120
8001991513,2cyclictest39-21ksoftirqd/309:15:113
8001991511,3cyclictest39-21ksoftirqd/312:30:433
800199150,14cyclictest0-21swapper/309:40:333
7997991513,1cyclictest0-21swapper/211:11:372
7994991515,0cyclictest0-21swapper/109:25:311
799499151,1cyclictest0-21swapper/110:38:221
7994991511,1cyclictest0-21swapper/111:36:561
799299152,5cyclictest0-21swapper/007:35:110
7992991515,0cyclictest0-21swapper/011:00:490
7992991513,1cyclictest0-21swapper/008:20:130
800199149,1cyclictest39-21ksoftirqd/311:24:293
800199143,7cyclictest2768-21/usr/sbin/munin11:25:203
800199141,4cyclictest0-21swapper/309:25:133
8001991411,2cyclictest5510-21cron10:30:003
800199140,11cyclictest0-21swapper/309:53:563
7997991411,2cyclictest19414-21grep07:30:252
7997991411,2cyclictest18040-21wc11:15:202
799799140,3cyclictest141rcu_preempt11:50:432
799799140,14cyclictest0-21swapper/210:50:522
799799140,13cyclictest0-21swapper/211:01:122
7994991413,1cyclictest986-21diskmemload10:46:331
799499141,2cyclictest141rcu_preempt09:52:501
799499140,2cyclictest0-21swapper/112:13:421
799499140,14cyclictest0-21swapper/111:06:341
7992991413,1cyclictest0-21swapper/010:20:070
7992991411,2cyclictest5501-21sed09:50:250
799299140,14cyclictest0-21swapper/011:48:450
799299140,12cyclictest0-21swapper/008:10:130
800199139,2cyclictest0-21swapper/311:15:193
800199138,4cyclictest10547-21ssh11:10:273
800199137,5cyclictest39-21ksoftirqd/310:20:203
800199134,3cyclictest225-21systemd-journal09:23:053
800199131,7cyclictest0-21swapper/312:25:133
800199131,6cyclictest0-21swapper/311:08:133
8001991312,1cyclictest39-21ksoftirqd/310:49:593
8001991310,1cyclictest0-21swapper/312:15:103
799799138,4cyclictest2802-21ntp_kernel_pll_09:10:202
7997991310,2cyclictest4984-21cut08:10:132
7997991310,2cyclictest3586-21tr11:45:192
7997991310,2cyclictest31373-21grep09:05:142
799799130,1cyclictest0-21swapper/209:58:362
799799130,1cyclictest0-21swapper/209:58:352
799799130,12cyclictest0-21swapper/209:25:142
799499139,3cyclictest27269-21cat07:50:011
799499138,4cyclictest9351-21awk08:20:011
799499132,1cyclictest1217-21apt-get11:25:111
7994991313,0cyclictest0-21swapper/109:39:191
7994991312,1cyclictest0-21swapper/112:20:011
7994991312,1cyclictest0-21swapper/109:40:341
799499131,1cyclictest141rcu_preempt10:32:241
7994991311,1cyclictest25-21ksoftirqd/109:24:421
7994991310,2cyclictest28431-21cat10:05:001
7994991310,2cyclictest28282-21grep07:50:161
7994991310,2cyclictest28181-21grep08:55:251
7994991310,2cyclictest19970-21cron10:00:011
7994991310,2cyclictest19970-21cron10:00:001
7994991310,2cyclictest1996-21idleruntime-cro08:05:011
7994991310,2cyclictest1996-21idleruntime-cro08:05:001
799499130,11cyclictest30192-21grep07:55:161
799499130,11cyclictest0-21swapper/111:03:221
799499130,10cyclictest0-21swapper/111:30:471
799299139,3cyclictest9828-21ssh11:10:220
7992991312,1cyclictest0-21swapper/012:32:300
7992991310,2cyclictest15532-21wc10:35:180
799299130,3cyclictest0-21swapper/011:21:550
800199129,2cyclictest5592-21grep08:10:173
800199129,2cyclictest3869-21sed09:30:213
800199129,2cyclictest29633-21cron07:55:003
800199129,2cyclictest22692-21wc12:35:253
800199129,2cyclictest22692-21wc12:35:243
800199129,2cyclictest17191-21tr08:35:153
800199129,2cyclictest14465-21sh10:15:213
800199128,3cyclictest4345-21ssh09:11:053
800199128,3cyclictest4294-21head11:45:253
800199128,3cyclictest27232-21cut11:40:173
800199128,3cyclictest23690-21chrt08:48:213
800199128,3cyclictest13935-21sort09:55:273
800199128,3cyclictest13935-21sort09:55:273
800199128,3cyclictest10628-21cut07:15:123
800199127,4cyclictest20729-21ssh10:57:553
800199125,3cyclictest15376-21apt-get07:25:133
800199122,7cyclictest0-21swapper/310:40:033
8001991210,1cyclictest16155-21ls08:30:263
800199120,11cyclictest32556-21wc09:05:213
800199120,11cyclictest14372-21sh10:35:123
799799129,2cyclictest7979-21cut08:15:172
799799129,2cyclictest30145-21tr09:00:212
799799129,2cyclictest29053-21tr09:45:222
799799129,2cyclictest2462-21rm09:30:112
799799129,2cyclictest22217-21cron07:40:002
799799129,2cyclictest20933-21sed11:55:282
799799129,2cyclictest20044-21cut08:40:172
799799129,2cyclictest11722-21cron08:25:002
7997991210,1cyclictest9454-21grep07:10:212
7997991210,1cyclictest26535-21cut11:20:202
799799120,2cyclictest0-21swapper/212:06:202
799799120,11cyclictest30151-21tr07:55:162
799499129,2cyclictest6275-21grep12:25:271
799499129,2cyclictest28076-21sh12:00:161
799499129,2cyclictest23149-21cat10:20:241
799499129,2cyclictest16091-21cat08:30:261
799499129,2cyclictest1585-21ssh09:48:491
799499129,2cyclictest10977-21tr11:50:131
799499124,7cyclictest12732-21perf07:19:591
799499124,4cyclictest225-21systemd-journal11:20:001
799499122,1cyclictest0-21swapper/111:48:121
799499122,10cyclictest986-21diskmemload10:55:151
799299129,2cyclictest26903-21grep09:25:140
799299129,2cyclictest25328-21taskset10:40:420
799299129,2cyclictest25021-21tr07:45:140
799299129,2cyclictest23795-21seq11:57:360
799299129,2cyclictest19868-21basename07:34:590
799299129,2cyclictest19273-21sh09:40:110
799299129,2cyclictest18666-21grep08:35:270
799299129,2cyclictest11243-21wc09:15:190
799299123,3cyclictest225-21systemd-journal08:00:000
799299122,6cyclictest4582-21/usr/sbin/munin12:25:150
7992991212,0cyclictest0-21swapper/011:39:280
7992991211,1cyclictest0-21swapper/011:52:270
7992991210,1cyclictest2006-21sleep08:05:010
7992991210,1cyclictest2006-21sleep08:05:000
7992991210,1cyclictest13910-21grep10:15:150
799299120,1cyclictest0-21swapper/012:35:220
799299120,1cyclictest0-21swapper/012:35:210
799299120,11cyclictest32330-21cat09:05:200
800199119,2cyclictest12689-21cut08:25:163
800199119,1cyclictest8348-21ntpq08:15:203
800199119,1cyclictest4780-21tr12:05:233
800199119,1cyclictest21784-21grep07:35:233
800199119,1cyclictest20529-21basename10:00:133
800199118,2cyclictest4698-21ssh10:10:073
800199118,2cyclictest30793-21chrt09:02:013
800199118,2cyclictest2964-21grep08:05:173
800199118,2cyclictest29198-21ssh09:45:233
800199118,2cyclictest25126-21cat08:50:193
800199118,2cyclictest24300-21wc11:00:143
800199118,2cyclictest23289-21cut07:40:163
800199118,2cyclictest19768-21chrt07:34:063
800199118,2cyclictest17653-21ssh11:35:003
800199118,2cyclictest14310-21sendmail_mailqu07:20:213
800199118,2cyclictest1188-21sh10:07:343
800199118,2cyclictest10826-21ssh11:50:133
800199118,2cyclictest1052-21ssh12:22:503
800199117,3cyclictest30709-21ssh12:01:263
800199110,10cyclictest28508-21chrt08:58:273
799799119,1cyclictest20552-21grep10:00:132
799799119,1cyclictest15112-21apt07:25:002
799799119,1cyclictest147902sleep208:30:142
799799118,2cyclictest32010-21sed10:25:262
799799118,2cyclictest26536-21wget11:40:132
799799118,2cyclictest22789-21tr07:40:132
799799118,2cyclictest18656-21cut11:35:162
799799118,2cyclictest17223-21cut08:35:152
799799118,2cyclictest1649-21ssh10:46:002
799799118,2cyclictest16431-21sh09:19:032
799799118,2cyclictest15713-21basename10:55:152
799799118,2cyclictest15414-21aten2_r7power_e07:25:142
799799118,2cyclictest13668-21sed08:25:252
799799118,2cyclictest10743-21cpu07:15:132
799799117,3cyclictest23822-21cron08:49:592
799799110,6cyclictest26767-21tr08:55:132
799499119,2cyclictest25342-21sh12:17:581
799499119,2cyclictest23960-21cut08:49:591
799499119,2cyclictest10641-21taskset11:10:331
799499119,1cyclictest5336-21grep08:10:141
799499119,1cyclictest5316-21grep12:05:271
799499119,1cyclictest20999-21grep08:40:271
799499119,1cyclictest15755-21cat07:25:151
799499118,2cyclictest4570-21ssh10:10:021
799499118,2cyclictest2811-21ssh10:27:521
799499118,2cyclictest26679-21ls11:20:221
799499118,2cyclictest26429-21cut08:55:001
799499118,2cyclictest17868-21aten2_r7power_v07:30:121
799499118,2cyclictest13219-21grep10:15:131
799499111,9cyclictest0-21swapper/110:43:451
799499110,10cyclictest30062-21ssh10:05:211
799299119,1cyclictest2547-21grep08:05:140
799299118,2cyclictest9868-21grep07:10:250
799299118,2cyclictest8827-21tr10:50:210
799299118,2cyclictest5598-21ssh12:05:370
799299118,2cyclictest32177-21tail10:45:180
799299118,2cyclictest29407-21cat09:45:250
799299118,2cyclictest2265-21sh09:30:040
799299118,2cyclictest1864-21seq09:10:130
799299118,2cyclictest17384-21cat10:55:270
799299118,2cyclictest15686-21strings08:30:190
7992991110,1cyclictest8581-21ssh10:30:530
800199108,2cyclictest10753-21grep08:20:193
800199108,1cyclictest81882sleep307:10:103
800199108,1cyclictest249442sleep307:45:123
800199107,2cyclictest32313-21cut08:00:143
800199107,2cyclictest32313-21cut08:00:133
800199107,2cyclictest31162-21proc_pri07:55:233
800199107,2cyclictest19345-21apache_accesses08:40:133
799799107,2cyclictest4505-21cut08:10:012
799799107,2cyclictest1344-21cat08:00:262
799799107,2cyclictest1344-21cat08:00:262
799499109,1cyclictest13572-21df07:20:151
799499109,1cyclictest10034-21cat08:20:141
799499108,2cyclictest30078-21ntpq09:00:191
799499108,1cyclictest32521-21grep09:05:221
799499108,1cyclictest2508-21cut08:05:141
799499108,1cyclictest21169-21cat07:35:171
799299109,1cyclictest0-21swapper/009:03:240
799299108,2cyclictest31600-21ssh11:42:550
799299108,2cyclictest23143-21ls08:45:250
799299108,2cyclictest12558-21expr09:55:160
799299108,2cyclictest12558-21expr09:55:150
799299108,1cyclictest26903-21expr08:55:140
799299108,1cyclictest20079-21grep08:40:180
799299108,1cyclictest17707-21head11:15:170
799299108,1cyclictest11465-21ssh12:10:030
799299107,2cyclictest11085-21aten2_r7power_p09:35:130
799299100,9cyclictest12783-21expr08:25:150
79949995,3cyclictest16958-21apache_volume08:35:131
79929997,1cyclictest8162-21uname08:15:190
79929997,1cyclictest22796-21cut07:40:130
79929997,1cyclictest15369-21apache_processe07:25:130
79929991,1cyclictest0-21swapper/007:20:110
79929991,1cyclictest0-21swapper/007:15:130
79929990,1cyclictest0-21swapper/008:50:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional