You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-19 - 12:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot3s.osadl.org (updated Fri Jun 19, 2026 00:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
305312238163,24sleep30-21swapper/319:09:163
304982235163,59sleep20-21swapper/219:08:502
302712201164,25sleep00-21swapper/019:05:540
286282201163,25sleep10-21swapper/119:05:061
30680991071,2cyclictest0-21swapper/222:50:322
30680999187,3cyclictest0-21swapper/220:24:562
30680995956,2cyclictest0-21swapper/222:31:122
115132540,2sleep10-21swapper/120:50:171
3066499508,12cyclictest23181-21idleruntime-cro20:05:010
218682480,3sleep00-21swapper/022:25:560
3066499369,12cyclictest5594-21awk19:25:000
3066499366,14cyclictest7778-21munin-run19:30:000
3066499352,26cyclictest25817-21kworker/0:321:24:360
3066499338,12cyclictest25014-21munin-run23:50:010
265782330,16sleep326576-21strings20:10:193
3066499312,16cyclictest10587-21munin-run20:50:010
3068599291,14cyclictest0-21swapper/300:05:143
3068599291,13cyclictest0-21swapper/322:18:053
3068599291,10cyclictest0-21swapper/321:42:483
3068599291,10cyclictest0-21swapper/320:00:413
3068599290,9cyclictest0-21swapper/322:20:133
3068599290,9cyclictest0-21swapper/321:47:583
30685992816,7cyclictest0-21swapper/321:15:143
3068599281,17cyclictest0-21swapper/320:29:573
3068599280,11cyclictest0-21swapper/321:04:243
3068599280,11cyclictest0-21swapper/320:43:243
3068099281,13cyclictest0-21swapper/200:39:232
3066499282,17cyclictest15341-21kworker/0:122:22:210
3066499281,12cyclictest31641-21idleruntime-cro00:05:010
3068599275,3cyclictest0-21swapper/323:25:043
3068599271,12cyclictest0-21swapper/320:30:343
3068599271,10cyclictest0-21swapper/321:59:443
3068599270,9cyclictest0-21swapper/321:10:203
3068599270,12cyclictest0-21swapper/321:50:223
3068599270,10cyclictest0-21swapper/319:44:533
3068599270,10cyclictest0-21swapper/300:20:383
3068099271,11cyclictest0-21swapper/219:58:442
3066499272,11cyclictest20268-21kworker/0:223:39:320
3066499272,10cyclictest27521-21kworker/0:020:26:050
3066499271,18cyclictest25817-21kworker/0:321:31:040
3066499270,11cyclictest3316-21kworker/0:100:13:420
3068599266,3cyclictest0-21swapper/323:45:043
3068599261,9cyclictest21182-21df23:40:143
3068599261,6cyclictest0-21swapper/300:00:223
3068599261,5cyclictest0-21swapper/321:30:583
3068599261,11cyclictest0-21swapper/319:15:163
3068599260,17cyclictest0-21swapper/321:05:123
3068099261,11cyclictest0-21swapper/223:59:282
3066499262,13cyclictest17803-21munin-run22:20:010
3066499262,10cyclictest2188-21kworker/0:321:47:560
3066499262,10cyclictest2090-21kworker/0:121:41:160
3066499262,10cyclictest13899-21kworker/0:023:30:040
3066499262,10cyclictest11690-21kworker/0:323:26:400
3066499261,17cyclictest7283-21kworker/0:023:11:490
3066499261,13cyclictest4006-21basename20:35:010
3066499261,11cyclictest3480-21kworker/0:200:25:140
3066499260,9cyclictest27154-21kworker/0:323:57:160
3068599252,3cyclictest0-21swapper/300:38:073
3068599251,9cyclictest0-21swapper/300:14:363
3068599251,11cyclictest0-21swapper/323:55:283
3068599251,11cyclictest0-21swapper/320:16:533
3068599251,11cyclictest0-21swapper/319:49:073
30685992510,3cyclictest0-21swapper/300:28:563
3068599250,7cyclictest0-21swapper/319:29:043
3068599250,11cyclictest0-21swapper/323:17:403
3068599250,11cyclictest0-21swapper/321:39:323
3068099250,11cyclictest0-21swapper/222:19:162
3067599251,8cyclictest25187-21kworker/u8:021:11:161
30675992512,6cyclictest32555-21kworker/u8:222:05:111
3066499258,2cyclictest27154-21kworker/0:300:05:200
3066499252,16cyclictest8949-21kworker/0:222:06:240
3068599248,2cyclictest0-21swapper/322:50:263
3068599241,9cyclictest0-21swapper/322:47:263
3068599241,6cyclictest0-21swapper/322:37:503
30685992411,3cyclictest0-21swapper/319:31:203
3068599241,13cyclictest0-21swapper/319:24:383
3068599241,11cyclictest0-21swapper/323:23:583
3068599241,11cyclictest0-21swapper/323:23:583
3068599241,10cyclictest0-21swapper/320:47:263
3068599240,10cyclictest0-21swapper/322:00:163
3068599240,10cyclictest0-21swapper/320:54:483
3068099240,11cyclictest0-21swapper/219:36:452
3067599241,8cyclictest0-21swapper/100:30:181
3067599241,8cyclictest0-21swapper/100:30:181
3067599241,11cyclictest0-21swapper/121:58:491
3067599240,9cyclictest0-21swapper/121:38:441
3066499249,2cyclictest12005-21kworker/0:219:40:160
3066499242,11cyclictest22473-21kworker/0:123:42:040
3066499242,10cyclictest7517-21kworker/0:019:54:040
3066499242,10cyclictest27571-21perf20:15:010
3066499241,9cyclictest28748-21kworker/0:122:50:250
3066499241,10cyclictest26514-21kworker/0:222:45:170
3068599231,8cyclictest0-21swapper/322:13:353
3068599231,8cyclictest0-21swapper/322:13:353
3068599231,3cyclictest0-21swapper/322:40:143
3068599231,3cyclictest0-21swapper/320:24:033
3068599231,14cyclictest19380-21diskmemload23:35:263
3068599231,11cyclictest17807-21timerandwakeup23:30:243
3068599231,11cyclictest0-21swapper/319:53:513
3068599231,10cyclictest0-21swapper/320:56:183
3068599231,10cyclictest0-21swapper/320:56:183
3068599230,14cyclictest0-21swapper/319:59:493
3068099234,12cyclictest19929-21taskset22:24:132
3067599236,8cyclictest0-21swapper/123:30:191
3067599232,11cyclictest16225-21munin-run23:30:021
3067599231,11cyclictest0-21swapper/122:25:371
3067599231,10cyclictest0-21swapper/122:24:031
3066499232,10cyclictest19855-21kworker/0:022:37:090
3066499231,6cyclictest0-21swapper/023:07:130
30664992312,2cyclictest19355-21kworker/0:221:40:000
3066499231,12cyclictest5285-21kworker/0:119:35:120
3066499231,12cyclictest11690-21kworker/0:323:19:520
3066499231,10cyclictest19355-21kworker/0:221:25:400
3068599229,2cyclictest0-21swapper/300:30:143
3068599229,2cyclictest0-21swapper/300:30:143
3068599226,6cyclictest0-21swapper/323:01:233
3068599226,3cyclictest0-21swapper/320:37:263
3068599226,3cyclictest0-21swapper/300:20:003
3068599221,9cyclictest0-21swapper/322:32:063
3068599221,9cyclictest0-21swapper/321:20:163
3068599221,8cyclictest0-21swapper/320:05:193
3068599221,12cyclictest0-21swapper/319:12:013
3068599221,11cyclictest0-21swapper/319:37:523
3067599228,12cyclictest25187-21kworker/u8:021:21:191
3067599227,3cyclictest10573-21crond20:50:001
3067599222,18cyclictest0-21swapper/120:39:241
3067599221,3cyclictest29641-21/usr/sbin/munin00:00:281
3067599221,3cyclictest13754-21ntp_states00:35:211
3067599221,16cyclictest0-21swapper/122:13:391
3067599221,16cyclictest0-21swapper/122:13:391
3067599221,14cyclictest0-21swapper/122:39:401
30675992211,3cyclictest23493-21ntp_states22:30:211
3066499222,11cyclictest3480-21kworker/0:200:23:060
3066499222,11cyclictest12495-21kworker/0:021:00:250
3066499222,10cyclictest19355-21kworker/0:221:12:120
3066499221,9cyclictest3480-21kworker/0:200:30:500
3066499221,9cyclictest3480-21kworker/0:200:30:500
3066499221,9cyclictest19355-21kworker/0:221:15:040
3066499221,10cyclictest2774-21kworker/0:222:57:170
3068599219,3cyclictest0-21swapper/323:06:083
3068599211,2cyclictest0-21swapper/322:55:263
3068599211,12cyclictest11434-21/usr/sbin/munin22:05:193
3068599210,9cyclictest0-21swapper/323:50:163
3068099215,3cyclictest8564-1kworker/u9:121:22:382
30680992116,3cyclictest29356-21grep20:15:242
3068099211,10cyclictest0-21swapper/222:35:202
3067599213,10cyclictest2037-21expr00:10:121
3067599212,15cyclictest0-21swapper/123:05:341
30675992117,3cyclictest0-21swapper/122:44:211
30675992117,3cyclictest0-21swapper/120:41:521
30675992116,3cyclictest29401-40updatedb00:00:021
30675992116,3cyclictest22819-21perf23:45:021
3067599211,3cyclictest773-21NetworkManager19:17:411
3067599211,3cyclictest0-21swapper/123:18:011
3067599211,11cyclictest9634-21munin-run23:15:011
3067599211,11cyclictest32711-21/usr/sbin/munin22:50:261
3067599211,11cyclictest2381-21entropy20:30:141
30675992110,3cyclictest6310-21unixbench-2d21:50:231
3066499211,4cyclictest0-21swapper/022:34:550
3066499210,10cyclictest2774-21kworker/0:223:02:450
3068599208,3cyclictest0-21swapper/323:10:283
3068599206,3cyclictest19380-21diskmemload22:25:103
3068599200,8cyclictest0-21swapper/321:27:563
3068099200,10cyclictest0-21swapper/220:02:042
3067599209,3cyclictest31517-21/usr/sbin/munin20:20:241
3067599208,5cyclictest0-21swapper/121:25:141
3067599204,3cyclictest16124-21missed_timers21:00:201
3067599202,16cyclictest0-21swapper/121:40:571
3067599202,16cyclictest0-21swapper/119:22:311
3067599201,7cyclictest808-21snmpd22:00:161
30675992017,2cyclictest0-21swapper/119:12:571
30675992016,3cyclictest0-21swapper/123:04:091
30675992016,3cyclictest0-21swapper/119:45:291
30675992016,3cyclictest0-21swapper/100:05:151
30675992016,2cyclictest28844-21ntp_states20:15:201
3067599201,4cyclictest0-21swapper/123:54:261
30675992014,3cyclictest19714-21ntp_states23:35:231
30675992013,3cyclictest0-21swapper/122:56:561
3067599201,2cyclictest9659-21chrt19:31:071
3067599201,17cyclictest0-21swapper/119:25:201
3067599201,16cyclictest19380-21diskmemload00:25:181
3067599201,15cyclictest0-21swapper/122:47:251
3067599201,14cyclictest0-21swapper/122:15:291
3067599201,10cyclictest13052-21cut19:40:151
3067599200,3cyclictest0-21swapper/123:21:161
3067599200,3cyclictest0-21swapper/123:21:161
3067599200,18cyclictest0-21swapper/120:28:261
3066499209,3cyclictest3904-21/usr/sbin/munin00:15:180
3066499208,2cyclictest12396-21kworker/0:100:35:340
3066499202,12cyclictest14253-21kworker/0:119:45:480
3066499200,10cyclictest14253-21kworker/0:119:58:520
3068099198,3cyclictest0-21swapper/221:54:492
3068099196,3cyclictest0-21swapper/223:07:422
3068099195,3cyclictest6257-21fschecks_count19:25:152
3068099194,3cyclictest89250irq/135-enp2s0-23:25:182
3068099193,10cyclictest5368-21chrt19:22:252
3068099192,14cyclictest13355-21diskstats20:55:142
3068099192,14cyclictest13355-21diskstats20:55:142
3068099191,6cyclictest0-21swapper/223:37:102
3068099191,5cyclictest0-21swapper/221:41:372
3067599199,2cyclictest21320-21cpuspeed_turbos20:00:101
3067599192,3cyclictest0-21swapper/121:48:021
3067599192,3cyclictest0-21swapper/121:34:501
3067599192,16cyclictest0-21swapper/119:58:461
30675991915,3cyclictest0-21swapper/119:37:081
30675991914,3cyclictest25749-21grep20:10:111
30675991914,3cyclictest23339-21tail21:15:281
3067599191,17cyclictest0-21swapper/121:05:541
3067599191,17cyclictest0-21swapper/120:57:331
3067599191,17cyclictest0-21swapper/120:57:321
3067599191,16cyclictest0-21swapper/120:05:071
3067599191,10cyclictest24578-21unixbench_singl23:45:271
3066499198,2cyclictest24712-21kworker/0:223:50:340
3066499195,3cyclictest8390-21perf20:45:010
3066499193,3cyclictest87450irq/127-enp1s0-20:54:030
3066499192,10cyclictest4431-21kworker/0:021:57:040
14882190,3sleep2311ktimersoftd/222:55:152
3068099187,3cyclictest87350irq/126-enp1s0-21:25:172
3068099185,3cyclictest0-21swapper/219:41:432
3068099184,3cyclictest0-21swapper/219:13:102
3068099184,2cyclictest0-21swapper/223:33:182
3068099183,6cyclictest24629-21users23:45:272
3068099183,3cyclictest0-21swapper/200:34:492
3068099183,3cyclictest0-21swapper/200:34:492
3068099181,7cyclictest20302-21grep22:25:112
3068099181,6cyclictest4510-21mailstats23:00:222
3068099181,5cyclictest0-21swapper/223:13:432
3068099181,3cyclictest0-21swapper/221:31:002
3068099181,3cyclictest0-21swapper/200:02:522
30680991812,3cyclictest8597-21gltestperf19:30:152
30680991812,3cyclictest23769-21idleruntime-cro21:20:012
30680991812,3cyclictest2024-21/usr/sbin/munin20:30:112
30680991812,3cyclictest1940-21grep19:15:142
3068099181,15cyclictest0-21swapper/223:50:112
30680991811,4cyclictest10972-21pmu-power23:15:212
30680991811,4cyclictest0-21swapper/222:00:172
3068099181,11cyclictest0-21swapper/221:55:252
3068099181,11cyclictest0-21swapper/219:45:142
3067599182,10cyclictest0-21swapper/119:50:071
3067599181,16cyclictest0-21swapper/100:21:101
3067599181,16cyclictest0-21swapper/100:18:591
3066499182,10cyclictest8949-21kworker/0:222:10:200
3066499182,10cyclictest8949-21kworker/0:222:10:200
3066499182,10cyclictest3933-21kworker/0:320:37:450
3066499181,9cyclictest30405-21kworker/0:019:13:120
30664991812,3cyclictest13127-21sh23:20:220
30664991812,3cyclictest13127-21sh23:20:220
3066499181,11cyclictest12495-21kworker/0:020:59:090
3066499181,11cyclictest12495-21kworker/0:020:59:090
3066499180,12cyclictest0-21swapper/022:40:200
286462180,3sleep20-21swapper/222:43:202
149682180,3sleep20-21swapper/222:10:252
149682180,3sleep20-21swapper/222:10:252
3068099176,3cyclictest0-21swapper/200:06:032
3068099174,4cyclictest16946-21sshd21:02:062
3068099174,3cyclictest0-21swapper/200:21:252
3068099173,3cyclictest0-21swapper/220:48:142
3068099173,2cyclictest87550irq/128-enp1s0-23:24:062
3068099173,2cyclictest87550irq/128-enp1s0-23:24:062
3068099172,12cyclictest535-21irqstats20:25:172
3068099171,8cyclictest8303-21taskset20:44:082
3068099171,6cyclictest29365-21dnf22:45:132
3068099171,6cyclictest0-21swapper/223:40:242
3068099171,6cyclictest0-21swapper/221:11:072
3068099171,4cyclictest0-21swapper/200:25:162
30680991712,3cyclictest4084-21sed21:45:262
30680991712,3cyclictest30598-21/usr/sbin/munin21:35:172
3068099171,15cyclictest0-21swapper/220:13:052
3068099171,15cyclictest0-21swapper/220:05:242
3068099171,14cyclictest12931-21unixbench_multi22:05:252
3068099171,10cyclictest0-21swapper/219:53:002
30680991710,4cyclictest4349-21tr20:35:122
3066499174,3cyclictest27521-21kworker/0:020:15:130
3066499172,10cyclictest4431-21kworker/0:021:50:120
3066499171,6cyclictest0-21swapper/022:00:070
3066499171,13cyclictest1390-21/usr/sbin/munin19:15:230
3068099161,4cyclictest0-21swapper/200:17:122
3068099161,4cyclictest0-21swapper/200:10:142
30680991611,3cyclictest18660-21sendmail_mailtr21:05:242
3066499161,4cyclictest29720-21kworker/0:120:20:150
3066499161,2cyclictest0-21swapper/021:05:040
30664991612,3cyclictest0-21swapper/019:30:160
3068099151,7cyclictest0-21swapper/220:50:192
3066499151,6cyclictest23393-21/usr/sbin/munin20:05:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional