You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 17:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Sat Aug 15, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1589529482,8sleep00-21swapper/007:06:090
285052920,0sleep10-21swapper/110:38:311
1616629267,9sleep30-21swapper/307:09:423
1587628459,6sleep10-21swapper/107:05:541
1604128371,8sleep20-21swapper/207:08:052
1628699280,28cyclictest0-21swapper/210:36:472
1628399260,24cyclictest0-21swapper/109:20:141
16289992523,1cyclictest381rcuc/310:45:223
1628699250,23cyclictest0-21swapper/211:48:032
1628699240,23cyclictest0-21swapper/210:15:152
1628699240,23cyclictest0-21swapper/210:07:342
1628999236,13cyclictest30551-21ssh12:15:483
1628699230,22cyclictest0-21swapper/211:00:142
1628399230,20cyclictest0-21swapper/111:30:521
1628999222,4cyclictest141rcu_preempt10:33:303
1628699220,22cyclictest0-21swapper/212:21:402
16283992220,1cyclictest0-21swapper/110:41:191
1628399220,21cyclictest0-21swapper/109:25:151
1628999217,12cyclictest39-21ksoftirqd/311:17:423
16289992113,2cyclictest39-21ksoftirqd/311:49:203
1628699211,3cyclictest5724-21apt-get10:25:132
1628699210,21cyclictest0-21swapper/209:43:272
1628699210,21cyclictest0-21swapper/209:43:272
16283992115,2cyclictest18995-21ssh09:35:121
16289992018,2cyclictest39-21ksoftirqd/309:23:133
1628999200,16cyclictest0-21swapper/310:02:163
1628699201,2cyclictest0-21swapper/211:27:532
1628699200,20cyclictest0-21swapper/212:04:592
1628699200,20cyclictest0-21swapper/211:56:332
1628699200,20cyclictest0-21swapper/209:33:092
16280992019,1cyclictest0-21swapper/009:24:170
1628999196,1cyclictest141rcu_preempt10:51:023
16289991917,2cyclictest39-21ksoftirqd/310:27:313
16289991914,5cyclictest39-21ksoftirqd/310:16:543
16289991912,6cyclictest39-21ksoftirqd/312:30:013
1628999190,1cyclictest0-21swapper/312:22:413
16286991915,3cyclictest32-21ksoftirqd/211:45:012
1628699190,19cyclictest0-21swapper/209:53:402
1628699190,17cyclictest0-21swapper/210:04:462
1628399190,18cyclictest0-21swapper/111:51:241
1628099190,14cyclictest0-21swapper/008:40:140
1628999185,3cyclictest141rcu_preempt12:35:473
16289991814,4cyclictest39-21ksoftirqd/310:56:143
1628999180,5cyclictest0-21swapper/311:35:323
1628699182,9cyclictest141rcu_preempt11:35:092
16286991817,1cyclictest0-21swapper/211:34:502
16286991814,3cyclictest311rcuc/207:55:142
1628699180,17cyclictest0-21swapper/209:24:382
1628399180,2cyclictest0-21swapper/112:05:141
1628399180,18cyclictest0-21swapper/110:18:241
1628099180,1cyclictest0-21swapper/012:02:180
1628099180,14cyclictest0-21swapper/010:33:370
16289991712,4cyclictest0-21swapper/309:56:243
1628699170,17cyclictest0-21swapper/210:31:482
1628699170,16cyclictest0-21swapper/212:17:162
1628699170,0cyclictest0-21swapper/211:19:192
16283991716,1cyclictest0-21swapper/110:04:231
1628399170,2cyclictest0-21swapper/112:33:501
1628399170,17cyclictest0-21swapper/111:27:141
1628099171,11cyclictest0-21swapper/011:45:130
1628099170,17cyclictest0-21swapper/009:49:170
1628099170,0cyclictest0-21swapper/010:17:130
1628999169,7cyclictest39-21ksoftirqd/310:22:093
1628999169,5cyclictest39-21ksoftirqd/309:43:463
1628999169,5cyclictest39-21ksoftirqd/309:43:453
1628699161,15cyclictest0-21swapper/209:49:032
1628699160,16cyclictest0-21swapper/211:11:172
1628399161,1cyclictest0-21swapper/110:07:071
1628399160,1cyclictest0-21swapper/109:43:001
1628399160,1cyclictest0-21swapper/109:42:591
1628399160,15cyclictest0-21swapper/111:14:521
1628399160,14cyclictest0-21swapper/109:13:221
1628999157,6cyclictest39-21ksoftirqd/311:50:493
1628999155,8cyclictest8867-21diskmemload09:39:303
16289991514,1cyclictest0-21swapper/311:55:243
1628999151,2cyclictest141rcu_preempt08:45:133
16289991511,4cyclictest39-21ksoftirqd/312:34:153
16289991511,4cyclictest39-21ksoftirqd/312:03:093
1628999150,11cyclictest0-21swapper/309:33:183
1628999150,0cyclictest0-21swapper/311:25:463
1628699152,10cyclictest2305-21mailstats07:45:222
1628699151,1cyclictest0-21swapper/211:06:122
1628699150,2cyclictest0-21swapper/210:11:002
1628699150,15cyclictest0-21swapper/212:30:522
1628699150,14cyclictest0-21swapper/211:53:482
1628699150,14cyclictest0-21swapper/209:39:522
1628699150,12cyclictest0-21swapper/212:27:542
1628399158,2cyclictest13542-21cut08:10:161
1628399150,2cyclictest0-21swapper/112:16:131
1628399150,14cyclictest0-21swapper/111:49:381
1628399150,0cyclictest0-21swapper/111:15:221
16280991514,1cyclictest0-21swapper/010:36:470
1628099150,1cyclictest0-21swapper/012:29:060
126622150,0sleep30-21swapper/311:07:183
1628999142,6cyclictest8867-21diskmemload09:53:133
1628999141,11cyclictest0-21swapper/309:49:053
16289991410,3cyclictest6006-21tr07:55:143
1628699149,4cyclictest455-21dbus-daemon12:40:002
1628699144,6cyclictest17843-21cut08:20:162
1628699144,4cyclictest32-21ksoftirqd/207:15:172
16286991410,3cyclictest19400-21wc09:15:242
1628699140,13cyclictest0-21swapper/210:43:412
1628399145,7cyclictest1409-21python11:00:241
16283991414,0cyclictest0-21swapper/109:47:371
16283991411,2cyclictest2718-21kworker/1:110:45:171
16283991410,2cyclictest30721-21cron07:40:001
1628399140,2cyclictest0-21swapper/112:39:051
1628399140,14cyclictest0-21swapper/109:16:301
1628399140,13cyclictest0-21swapper/109:33:201
1628099141,7cyclictest7896-21munin-run08:00:010
1628099141,7cyclictest383-21munin-run11:20:010
1628999138,2cyclictest29315-21cron08:45:003
1628999134,3cyclictest39-21ksoftirqd/310:35:103
1628999132,9cyclictest16688-21ssh11:10:153
16289991310,2cyclictest2914-21grep11:20:263
16289991310,2cyclictest23232-21sed08:30:183
1628699139,2cyclictest32-21ksoftirqd/210:50:152
16286991310,2cyclictest22284-21cut07:20:182
16286991310,2cyclictest14754-21cron10:49:592
1628699130,13cyclictest0-21swapper/211:20:572
1628399139,3cyclictest25975-21cron07:30:001
1628399138,4cyclictest771-21ssh10:21:331
16283991310,2cyclictest6666-21cat09:05:001
16283991310,2cyclictest4020-21cron09:00:001
16283991310,2cyclictest26515-21grep08:35:271
1628399130,8cyclictest0-21swapper/108:50:131
1628399130,12cyclictest15559-21tr08:15:151
1628099134,7cyclictest20926-21aten2_r7power_e12:30:150
16280991310,2cyclictest6050-21cat10:05:260
16280991310,2cyclictest31743-21grep10:40:170
16280991310,2cyclictest30268-21tail07:35:260
16280991310,2cyclictest29325-21grep12:15:190
16280991310,2cyclictest26503-21tr07:30:150
1628099130,13cyclictest0-21swapper/012:07:300
1628999129,2cyclictest7972-21grep09:05:223
1628999129,2cyclictest5143-21grep10:05:163
1628999129,2cyclictest31792-21sed07:40:173
1628999129,2cyclictest2407-21df08:55:163
1628999129,2cyclictest17929-21grep11:30:153
1628999129,2cyclictest17844-21tr08:20:153
1628999129,2cyclictest14965-21grep10:10:263
1628999128,3cyclictest5861-21ssh11:41:513
16289991211,1cyclictest39-21ksoftirqd/309:14:063
1628699129,2cyclictest25113-21grep08:35:152
1628699129,2cyclictest21948-21grep09:55:262
1628699129,2cyclictest20070-21tr12:10:152
1628699129,2cyclictest16801-21tr07:10:142
1628699129,2cyclictest1201-21grep08:50:252
1628699129,1cyclictest0-21swapper/209:11:302
1628699127,4cyclictest32-21ksoftirqd/210:55:152
16286991210,1cyclictest32-21ksoftirqd/209:27:532
1628399129,2cyclictest8437-21tr08:00:141
1628399129,2cyclictest7004-21grep07:55:221
1628399129,2cyclictest5873-21cat12:20:261
1628399129,2cyclictest27347-21grep11:35:201
1628399129,2cyclictest23115-21sed07:20:271
1628399129,2cyclictest0-21swapper/112:04:041
1628399128,3cyclictest6781-21cut09:05:131
1628399128,3cyclictest27967-21sed08:40:171
1628399128,2cyclictest3894-21grep07:50:161
16283991211,1cyclictest0-21swapper/111:57:111
1628399120,9cyclictest8961-21cut11:05:161
1628399120,1cyclictest0-21swapper/110:26:421
1628399120,12cyclictest0-21swapper/110:32:411
1628399120,12cyclictest0-21swapper/109:59:411
1628099129,2cyclictest32247-21tr08:50:140
1628099129,2cyclictest24009-21wget07:25:140
1628099129,2cyclictest19849-21grep09:35:180
1628099129,2cyclictest16124-21cron11:10:010
1628099129,2cyclictest15040-21munin-plugin-st08:15:010
1628099129,2cyclictest13593-21ssh10:10:140
1628099129,2cyclictest11717-21ssh09:50:130
1628099123,1cyclictest9690-21cstates11:25:140
16280991211,1cyclictest0-21swapper/011:14:060
16280991210,1cyclictest16126-21grep10:50:190
16280991210,1cyclictest0-21swapper/009:58:160
1628099120,3cyclictest0-21swapper/011:30:200
1628099120,0cyclictest0-21swapper/011:56:490
298322110,0sleep00-21swapper/009:40:500
298322110,0sleep00-21swapper/009:40:490
1628999118,2cyclictest5436-21seq07:54:573
1628999118,2cyclictest5389-21ssh11:03:153
1628999118,2cyclictest3574-21ssh09:25:213
1628999118,2cyclictest31231-21expr10:40:143
1628999118,2cyclictest29565-21cut07:35:193
1628999118,2cyclictest24135-21expr07:25:153
1628999118,2cyclictest2386-21cat07:45:253
1628999118,2cyclictest23220-21chrt07:20:263
1628999118,2cyclictest20700-21cat07:15:273
1628999118,2cyclictest19554-21ssh12:10:023
1628999118,2cyclictest16071-21head08:15:193
1628999118,2cyclictest11691-21tr12:05:143
1628999117,3cyclictest39-21ksoftirqd/309:16:483
1628999114,3cyclictest39-21ksoftirqd/307:35:013
1628999110,10cyclictest8520-21expr08:00:153
1628699118,2cyclictest32762-21taskset07:40:302
1628699118,2cyclictest26559-21cstates07:30:152
1628699118,2cyclictest2645-21grep08:55:182
1628699118,2cyclictest25111-21head07:25:222
1628699118,2cyclictest21685-21sed08:25:262
1628699118,2cyclictest12437-21cat12:05:182
1628699118,2cyclictest11253-21grep08:05:192
1628699117,3cyclictest6993-21tr09:05:152
1628699115,2cyclictest225-21systemd-journal08:45:002
1628399118,2cyclictest7159-21ssh11:23:411
1628399118,2cyclictest31642-21taskset08:49:281
1628399118,2cyclictest2589-21ssh11:40:161
1628399118,2cyclictest24683-21head10:55:161
1628399118,2cyclictest23161-21grep08:30:181
1628399118,2cyclictest20110-21wget08:25:141
1628399118,2cyclictest19539-21ssh12:10:011
1628399118,2cyclictest18173-21cat08:20:161
1628399118,2cyclictest17179-21ssh09:53:101
1628399118,2cyclictest16127-21sed10:50:191
1628399118,2cyclictest14717-21ssh10:10:241
1628399118,2cyclictest10927-21cat08:05:161
1628399117,3cyclictest15278-21ssh12:26:031
1628099119,1cyclictest8796-21sort08:00:160
1628099119,1cyclictest26460-21grep08:35:270
1628099119,1cyclictest15403-21cut08:15:140
1628099119,1cyclictest1194-21grep07:45:150
1628099118,2cyclictest9956-21ssh10:27:070
1628099118,2cyclictest9696-21ssh12:23:130
1628099118,2cyclictest8159-21rm09:28:260
1628099118,2cyclictest5934-21grep09:00:240
1628099118,2cyclictest4371-21ssh11:40:420
1628099118,2cyclictest32142-21chrt12:36:110
1628099118,2cyclictest2994-21chrt11:01:220
1628099118,2cyclictest26409-21tr11:35:140
1628099118,2cyclictest24693-21grep10:55:160
1628099118,2cyclictest1393-21ssh10:22:010
1628099118,2cyclictest13765-21ssh09:31:180
1628099118,2cyclictest12657-21ls08:10:000
1628099110,10cyclictest21196-21ssh11:50:460
1628999108,1cyclictest329-21basename08:50:173
1628999108,1cyclictest25422-21fschecks_count08:35:173
1628999108,1cyclictest21383-21gzip08:25:223
1628999108,1cyclictest147072sleep308:10:593
1628999107,2cyclictest16800-21grep07:10:143
1628999105,4cyclictest5053-21gltestperf09:00:163
1628699107,2cyclictest8401-21tr08:00:142
1628699107,2cyclictest32767-21sh10:21:122
1628699107,2cyclictest30369-21cut08:45:172
1628699107,2cyclictest23159-21expr08:30:182
1628699102,3cyclictest225-21systemd-journal09:04:562
16286991010,0cyclictest0-21swapper/207:35:132
1628399108,1cyclictest31557-21df_abs07:40:141
1628399108,1cyclictest26935-21grep07:30:171
1628399108,1cyclictest184702sleep107:13:151
1628399107,2cyclictest21138-21chrt07:19:121
1628399107,2cyclictest1679-21grep07:45:181
1628099108,2cyclictest11787-21sh09:10:460
1628099108,1cyclictest6874-21ssh10:45:100
1628099108,1cyclictest5363-21ssh11:22:190
1628099108,1cyclictest31356-21expr07:40:140
1628099108,1cyclictest28339-21sh10:00:090
1628099108,1cyclictest24099-21sed08:30:270
1628099108,1cyclictest21940-21rm12:10:340
1628099107,2cyclictest21819-21expr07:20:160
1628099107,2cyclictest17177-21tune2fs07:10:170
1628099107,1cyclictest141rcu_preempt09:17:320
1628099107,1cyclictest0-21swapper/007:15:130
162899997,1cyclictest11170-21expr08:05:183
162869997,1cyclictest4558-21pmu-power07:50:222
162869996,2cyclictest16031-21tail08:15:172
162869996,2cyclictest12876-21chrt08:10:022
162809998,1cyclictest8950-21date09:10:000
162809998,1cyclictest3742-21sshd08:56:300
162809997,1cyclictest31102-21ls08:45:260
162809997,1cyclictest176632sleep008:20:070
162809987,1cyclictest3300-21sshd07:50:020
162809985,2cyclictest20036-21seq08:25:060
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional