You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-09 - 17:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Tue Jun 09, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2783229749,42sleep00-21swapper/007:05:200
2679229280,8sleep20-21swapper/207:05:112
2887329163,8sleep30-21swapper/307:09:263
2859628765,18sleep10-21swapper/107:05:491
2900699280,28cyclictest0-21swapper/211:46:052
2900699280,28cyclictest0-21swapper/211:15:282
2901099270,26cyclictest0-21swapper/309:40:273
2901099258,17cyclictest39-21ksoftirqd/311:00:143
2900699240,20cyclictest0-21swapper/210:20:482
29010992222,0cyclictest0-21swapper/309:23:413
29010992211,9cyclictest39-21ksoftirqd/307:55:143
29010992211,9cyclictest39-21ksoftirqd/307:55:133
2901099220,22cyclictest0-21swapper/309:47:173
2901099220,0cyclictest0-21swapper/310:24:253
2900099223,1cyclictest21814-21diskmemload12:23:040
2901099210,2cyclictest0-21swapper/311:57:453
2901099210,20cyclictest21814-21diskmemload10:55:453
29003992121,0cyclictest0-21swapper/111:25:371
2900399210,15cyclictest21814-21diskmemload11:50:081
235592210,0sleep00-21swapper/011:26:270
2901099200,2cyclictest39-21ksoftirqd/312:15:583
2901099200,19cyclictest0-21swapper/309:20:003
2900699204,12cyclictest0-21swapper/212:35:142
2900699201,2cyclictest0-21swapper/209:51:002
2900699201,2cyclictest0-21swapper/209:50:592
2900699200,16cyclictest0-21swapper/210:50:052
2900399205,11cyclictest13175-21cron11:59:591
2900099204,15cyclictest0-21swapper/008:20:130
2900099201,18cyclictest0-21swapper/010:25:420
2901099192,2cyclictest0-21swapper/311:39:343
29010991914,5cyclictest39-21ksoftirqd/312:12:303
29010991914,5cyclictest39-21ksoftirqd/309:12:553
2901099191,2cyclictest0-21swapper/312:22:293
29006991911,6cyclictest32-21ksoftirqd/211:29:482
2900699190,1cyclictest0-21swapper/209:26:522
2900099197,6cyclictest8520-21munin-run07:34:590
29010991817,1cyclictest0-21swapper/309:33:313
29010991817,1cyclictest0-21swapper/309:26:353
29010991816,2cyclictest381rcuc/310:14:453
29010991815,3cyclictest39-21ksoftirqd/312:32:043
29010991815,2cyclictest0-21swapper/310:32:223
29006991818,0cyclictest0-21swapper/209:32:272
29006991817,1cyclictest0-21swapper/209:21:252
29006991812,4cyclictest537-21snmpd10:04:532
2900699180,18cyclictest0-21swapper/209:41:242
2900399180,18cyclictest0-21swapper/110:15:431
2900399180,17cyclictest0-21swapper/109:51:001
2900399180,17cyclictest0-21swapper/109:51:001
2900399180,17cyclictest0-21swapper/109:17:041
2900099184,7cyclictest13494-21idleruntime-cro07:44:590
289012180,1sleep30-21swapper/311:49:553
2901099176,11cyclictest0-21swapper/308:40:123
29010991713,4cyclictest21814-21diskmemload11:23:383
29006991717,0cyclictest0-21swapper/212:29:072
29006991714,2cyclictest23273-21sh10:47:492
29006991713,3cyclictest0-21swapper/208:10:162
2900699170,17cyclictest0-21swapper/212:33:012
2900699170,17cyclictest0-21swapper/212:23:572
2900699170,17cyclictest0-21swapper/210:09:032
2900399171,0cyclictest0-21swapper/110:44:351
199112170,0sleep00-21swapper/010:06:370
2901099167,6cyclictest0-21swapper/310:07:023
2901099166,9cyclictest12882-21acpi11:40:083
2901099164,11cyclictest0-21swapper/308:30:133
29010991611,4cyclictest8102-21/usr/sbin/munin10:00:223
29006991612,3cyclictest32-21ksoftirqd/211:32:392
2900699160,2cyclictest0-21swapper/210:16:432
2900699160,1cyclictest141rcu_preempt10:42:312
2900699160,1cyclictest0-21swapper/210:11:362
2900399168,4cyclictest2868-21ssh11:33:591
2900399161,14cyclictest0-21swapper/111:00:141
2900399160,16cyclictest0-21swapper/112:33:011
2900099161,13cyclictest14819-21ssh09:25:140
2901099158,3cyclictest21814-21diskmemload09:35:513
29010991514,1cyclictest0-21swapper/311:31:523
29010991513,2cyclictest0-21swapper/312:00:143
29010991513,1cyclictest21805-21ls09:10:003
2901099151,13cyclictest0-21swapper/311:11:223
2901099150,7cyclictest0-21swapper/310:51:063
2901099150,1cyclictest0-21swapper/311:07:003
29006991514,1cyclictest291irq_work/212:08:112
2900699150,0cyclictest0-21swapper/211:41:182
29003991514,1cyclictest25-21ksoftirqd/112:16:011
2900399150,15cyclictest0-21swapper/109:58:271
2900099156,3cyclictest141rcu_preempt10:41:400
29000991511,3cyclictest6316-21cat11:35:250
2901099147,5cyclictest0-21swapper/309:53:233
2901099147,5cyclictest0-21swapper/309:53:223
2901099147,4cyclictest21814-21diskmemload12:39:103
2901099146,8cyclictest27618-21sh12:08:193
2901099144,10cyclictest0-21swapper/311:25:133
29010991412,1cyclictest0-21swapper/310:46:273
29010991411,2cyclictest17033-21munin-plugin-st09:00:003
29010991411,1cyclictest17237-21apt-get10:25:133
29010991410,3cyclictest39-21ksoftirqd/310:40:003
29010991410,3cyclictest30652-21tr08:20:133
2901099140,2cyclictest0-21swapper/311:50:133
2901099140,13cyclictest6130-21cron07:29:593
2901099140,13cyclictest11279-21cron11:20:003
2900699148,5cyclictest28991-21cyclictest10:37:542
2900699146,3cyclictest18553-21cron11:05:002
29003991414,0cyclictest0-21swapper/112:29:511
29003991413,1cyclictest32694-21sed08:25:001
2900399141,2cyclictest20952-21latency_hist11:45:001
2900099149,4cyclictest1459-21/usr/sbin/munin10:35:140
2900099140,13cyclictest26866-21cron11:10:000
2901099139,3cyclictest30273-21wc08:20:013
2901099139,3cyclictest18029-21grep09:00:163
2901099138,4cyclictest7111-21tail07:30:173
2901099136,6cyclictest23558-21cut12:25:183
29010991312,1cyclictest39-21ksoftirqd/309:57:293
29010991310,2cyclictest29459-21tr07:10:143
29010991310,2cyclictest24887-21sed08:05:273
29010991310,2cyclictest2363-21grep07:20:173
2900699139,3cyclictest31149-21head12:10:192
2900699139,1cyclictest0-21swapper/209:55:282
29006991311,1cyclictest0-21swapper/211:58:022
29006991310,2cyclictest32580-21grep09:15:262
2900699130,13cyclictest0-21swapper/212:15:112
2900699130,12cyclictest9696-21grep07:35:162
2900399137,5cyclictest23110-21ssh11:07:031
2900399131,12cyclictest0-21swapper/109:26:361
29003991310,2cyclictest31445-21cat12:10:201
29003991310,2cyclictest22745-21head12:05:151
29003991310,2cyclictest10143-21grep10:00:281
2900399130,13cyclictest0-21swapper/112:35:401
2900099139,2cyclictest16396-21tr07:50:150
2900099139,2cyclictest13799-21wc08:50:220
2900099137,3cyclictest27365-21apt-get11:10:110
2900099131,8cyclictest23655-21aten2_r7power_c09:50:130
2900099131,8cyclictest23655-21aten2_r7power_c09:50:120
2900099131,2cyclictest0-21swapper/009:55:140
29000991312,1cyclictest0-21swapper/011:04:190
2900099130,9cyclictest0-21swapper/008:40:130
2900099130,8cyclictest0-21swapper/009:05:120
2900099130,2cyclictest0-21swapper/011:34:200
2900099130,1cyclictest0-21swapper/010:52:230
286922130,1sleep00-21swapper/012:09:120
2901099129,2cyclictest6970-21wc08:35:253
2901099129,2cyclictest12930-21sort07:40:263
2901099129,2cyclictest12298-21basename08:50:003
2901099128,3cyclictest25784-21grep08:10:123
2901099126,5cyclictest39-21ksoftirqd/307:35:123
2901099124,4cyclictest225-21systemd-journal10:16:283
2901099120,1cyclictest0-21swapper/310:42:433
2900699129,2cyclictest8550-21grep08:40:162
2900699129,2cyclictest3582-21head08:30:182
2900699129,2cyclictest25663-21grep10:30:122
2900699129,2cyclictest23018-21grep08:05:012
2900699129,2cyclictest17448-21grep09:00:132
2900699129,2cyclictest13273-21grep08:50:162
2900699128,3cyclictest23380-21cut08:05:152
29006991211,1cyclictest21814-21diskmemload11:37:122
29006991210,1cyclictest30438-21hddtemp_smartct11:50:182
2900699120,2cyclictest0-21swapper/209:12:062
2900399129,2cyclictest4403-21sed10:55:261
2900399129,2cyclictest25906-21tr08:10:111
2900399129,2cyclictest24974-21grep09:30:261
2900399129,2cyclictest23105-21grep09:10:171
2900399129,2cyclictest23024-21munin-run08:05:011
2900399129,2cyclictest21337-21sed09:05:241
2900399129,2cyclictest16875-21grep07:50:171
2900399129,2cyclictest14031-21grep12:00:151
2900399129,2cyclictest12443-21idleruntime-cro11:40:011
2900399129,2cyclictest10898-21head08:45:181
2900399128,3cyclictest20887-21ssh09:48:141
2900399127,2cyclictest24073-21ssh10:09:541
2900399126,2cyclictest225-21systemd-journal07:25:001
29003991210,1cyclictest16333-21grep12:20:271
2900099129,2cyclictest9777-21grep10:20:170
2900099129,2cyclictest31517-21cat12:10:200
2900099129,2cyclictest30154-21awk08:20:010
2900099129,2cyclictest26527-21ssh10:10:240
2900099129,2cyclictest2439-21sed07:20:170
2900099129,2cyclictest24023-21grep08:05:180
2900099129,2cyclictest21332-21sh12:04:550
2900099129,2cyclictest18527-21cut10:45:130
2900099129,2cyclictest17233-21wc08:59:590
2900099129,2cyclictest10598-21grep07:35:250
2900099128,2cyclictest24325-21tr09:30:190
2900099128,2cyclictest14200-21tr11:40:180
2900099122,3cyclictest0-21swapper/011:15:180
29000991210,1cyclictest1171-21grep08:25:160
2900099120,11cyclictest30012-21grep07:10:160
2900099120,0cyclictest0-21swapper/010:58:420
2901099118,2cyclictest39-21ksoftirqd/307:19:593
2901099118,2cyclictest2302-21chrt08:26:583
2901099118,2cyclictest22127-21grep08:00:213
2901099111,5cyclictest39-21ksoftirqd/307:50:193
2900699118,2cyclictest7158-21grep07:30:172
2900699118,2cyclictest513-21seq09:35:232
2900699118,2cyclictest4651-21grep07:25:142
2900699118,2cyclictest3260-21ssh10:55:162
2900699118,2cyclictest32-21ksoftirqd/211:10:132
2900699118,2cyclictest30186-21sleep08:20:012
2900699118,2cyclictest19279-21head07:55:182
2900699118,2cyclictest19279-21head07:55:182
2900699118,2cyclictest19064-21sed10:25:252
2900699118,2cyclictest18009-21chrt07:52:102
2900699118,2cyclictest17847-21sh09:45:482
2900699118,2cyclictest16612-21grep08:55:272
2900699118,2cyclictest14943-21cat12:00:212
2900699115,5cyclictest12117-21aten2_r7power_e11:20:142
2900699114,3cyclictest225-21systemd-journal08:30:012
2900699113,4cyclictest225-21systemd-journal07:50:002
2900399118,2cyclictest4954-21ssh11:15:231
2900399118,2cyclictest25545-21apache_volume10:30:121
2900399118,2cyclictest25-21ksoftirqd/109:00:121
2900399118,2cyclictest24415-21ntpq08:05:211
2900399118,2cyclictest15250-21cat08:55:151
2900399118,2cyclictest11973-21rm11:20:111
2900399117,3cyclictest9272-21tr10:20:151
2900399117,3cyclictest20220-21grep10:45:251
2900399117,1cyclictest23002-21ssh10:28:241
2900399111,5cyclictest24722-21ssh10:10:121
2900399111,0cyclictest141rcu_preempt10:50:121
29003991110,0cyclictest0-21swapper/107:15:121
2900399110,1cyclictest0-21swapper/109:23:561
2900399110,10cyclictest32172-21grep09:35:171
2900099118,2cyclictest9791-21ssh12:36:100
2900099118,2cyclictest8190-21ssh11:56:010
2900099118,2cyclictest7350-21tr12:15:200
2900099118,2cyclictest7300-21grep09:40:140
2900099118,2cyclictest4676-21cut07:25:150
2900099118,2cyclictest2995-21ssh10:15:430
2900099118,2cyclictest28056-21ssh10:30:500
2900099118,2cyclictest27340-21grep08:10:230
2900099118,2cyclictest2366-21ssh11:52:580
2900099118,2cyclictest22647-21ssh11:45:220
2900099118,2cyclictest21150-21tr08:00:130
2900099118,2cyclictest20572-21chrt07:59:390
2900099118,2cyclictest20572-21chrt07:59:390
2900099118,2cyclictest1891-21ssh09:36:110
2900099118,2cyclictest16608-21cat09:45:210
2900099118,2cyclictest10709-21ssh10:00:540
2900099118,2cyclictest1016-21ssh09:16:030
2900099117,3cyclictest19418-21sh09:05:000
2900099115,2cyclictest225-21systemd-journal08:39:590
2900099112,6cyclictest10837-21tune2fs08:45:170
2900099110,3cyclictest0-21swapper/009:12:560
2900099110,11cyclictest0-21swapper/012:26:350
2901099108,1cyclictest14183-21awk08:50:263
2901099100,6cyclictest14433-21cut07:45:173
2900699108,1cyclictest6712-21gzip08:35:212
2900699108,1cyclictest31017-21forks08:20:152
2900699108,1cyclictest20029-21expr09:05:142
2900699108,1cyclictest11777-21expr07:40:152
2900699108,1cyclictest11318-21cat08:45:222
2900699107,2cyclictest31801-21aten2_r7power_v07:15:132
2900699107,2cyclictest29319-21basename07:10:132
2900699107,2cyclictest2473-21basename07:20:172
2900699105,4cyclictest21814-21diskmemload11:06:232
2900399108,1cyclictest4259-21cut07:25:131
2900399108,1cyclictest298152sleep107:10:151
2900399108,1cyclictest18728-21grep07:55:161
2900399108,1cyclictest18728-21grep07:55:161
2900399108,1cyclictest144782sleep108:52:571
2900399108,1cyclictest13961-21cat07:45:151
2900399107,2cyclictest9416-21expr07:35:141
2900399107,2cyclictest8745-21cut08:40:181
2900399107,2cyclictest6757-21cat07:30:141
2900399107,2cyclictest4994-21rm10:36:391
2900399107,2cyclictest29556-21cat08:15:271
2900399107,2cyclictest27134-21ssh11:10:031
2900399107,2cyclictest23388-21ssh11:45:331
2900399107,2cyclictest11457-21tr07:40:131
2900399100,10cyclictest9640-21chrt09:40:481
2900099108,1cyclictest8654-21ssh09:20:320
2900099107,2cyclictest501-21ssh12:30:240
2900099107,2cyclictest31912-21tr07:15:140
2900099107,2cyclictest13991-21grep07:45:150
2900099106,3cyclictest2885-21grep08:30:140
2900099100,9cyclictest13101-21ssh11:20:190
290039998,1cyclictest6366-21sort08:35:181
290039997,1cyclictest3531-21head08:30:171
290039985,2cyclictest404-21chrt08:25:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional