You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 20:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Tue Dec 16, 2025 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40395729912781,1273cyclictest41261072sleep308:14:563
40395729912580,1255cyclictest873842sleep310:14:563
40395729912150,1211cyclictest40934722sleep307:49:563
40395729911580,1154cyclictest1197442sleep310:39:563
404831422070,1sleep03992896-21kworker/0:1+mm_percpu_wq07:15:070
403957299229,1cyclictest0-21swapper/308:35:113
4039572992212,1cyclictest0-21swapper/308:59:223
4039572992112,1cyclictest0-21swapper/307:53:103
4039572992011,1cyclictest0-21swapper/311:36:143
4039572992011,0cyclictest0-21swapper/311:03:363
4039572991914,3cyclictest0-21swapper/307:15:193
4039572991912,0cyclictest0-21swapper/310:16:173
4039572991911,0cyclictest0-21swapper/311:55:403
4039572991911,0cyclictest0-21swapper/309:43:293
4039572991613,1cyclictest0-21swapper/312:40:003
4039572991613,1cyclictest0-21swapper/308:50:003
403957299161,11cyclictest113067-21turbostat10:35:003
4039572991513,1cyclictest0-21swapper/312:13:323
4039572991513,1cyclictest0-21swapper/311:45:013
4039572991512,1cyclictest0-21swapper/312:17:173
4039572991512,1cyclictest0-21swapper/309:30:163
4039572991512,1cyclictest0-21swapper/309:00:513
4039572991512,1cyclictest0-21swapper/307:25:353
745382141,9sleep074744-21cat10:05:000
403957299144,8cyclictest228918-21taskset12:04:103
403957299141,9cyclictest184277-21taskset11:30:123
4039572991413,0cyclictest0-21swapper/310:05:393
4039572991413,0cyclictest0-21swapper/308:22:053
4039572991412,1cyclictest0-21swapper/311:50:183
4039572991412,1cyclictest0-21swapper/311:28:203
4039572991412,1cyclictest0-21swapper/307:10:313
4039572991412,0cyclictest0-21swapper/308:51:483
4039572991411,1cyclictest0-21swapper/309:36:223
403957299141,10cyclictest4112634-21chrt08:03:063
403957299141,10cyclictest4073766-21turbostat07:35:003
403957299141,10cyclictest208786-21taskset11:45:193
403957299141,10cyclictest164991-21chrt11:15:023
403957299140,11cyclictest3985-21taskset09:10:013
1197482141,9sleep2119757-21sh10:40:002
1066332145,6sleep0106812-21cut10:30:000
424902131,4sleep042523-21apt-get09:40:120
403957299134,7cyclictest267629-21taskset12:32:273
403957299133,7cyclictest4151541-21taskset08:31:113
403957299131,9cyclictest4079825-21taskset07:35:503
403957299131,9cyclictest254072-21chrt12:20:173
4039572991312,0cyclictest0-21swapper/312:27:503
4039572991312,0cyclictest0-21swapper/310:45:303
4039572991312,0cyclictest0-21swapper/310:27:283
4039572991311,1cyclictest0-21swapper/308:15:213
403957299131,10cyclictest68369-21taskset10:00:013
403957299131,10cyclictest61953-21taskset09:55:013
403957299131,10cyclictest4100132-21taskset07:55:013
4039572991311,0cyclictest0-21swapper/309:05:173
4039572991310,1cyclictest0-21swapper/309:20:243
403957299130,10cyclictest4139227-21chrt08:25:023
403957299130,10cyclictest4119206-21chrt08:07:033
403957299130,10cyclictest4086788-21chrt07:41:273
403957299130,10cyclictest29035-21taskset09:25:523
403957299130,10cyclictest234322-21taskset12:05:183
403957299130,10cyclictest158087-21chrt11:06:443
403957299130,10cyclictest144708-21taskset10:55:233
403957299130,10cyclictest132848-21chrt10:50:103
403957299130,10cyclictest125347-21taskset10:40:213
41136052121,8sleep24113763-21/usr/sbin/munin08:05:152
403957299129,1cyclictest0-21swapper/309:15:153
403957299121,9cyclictest61483-21taskset09:52:043
4039572991211,0cyclictest0-21swapper/311:20:173
403957299120,9cyclictest99945-21chrt10:21:293
403957299120,9cyclictest49134-21chrt09:45:073
403957299120,9cyclictest4158530-21taskset08:40:043
403957299120,9cyclictest4060586-21chrt07:20:473
403957299120,9cyclictest164408-21taskset11:10:373
301798120,4rtkit-daemon676-21runrttasks11:03:000
93152111,7sleep09424-21plymouth09:10:240
752642110,8sleep076251-21irqstats10:05:160
40728512111,6sleep24072908-21ntp_states07:30:212
301798110,4rtkit-daemon636-21snmpd12:08:530
301798110,4rtkit-daemon492-21gmain10:38:180
301798110,4rtkit-daemon4046069-21munin-node08:12:181
1912142115,3sleep2192177-21cut11:35:182
426702101,6sleep242698-21cut09:40:142
41080622101,2sleep20-21swapper/208:00:192
40459112101,6sleep04046069-21munin-node07:15:000
40397292101,2sleep20-21swapper/207:10:132
301798100,5rtkit-daemon93090-21python310:15:220
301798100,5rtkit-daemon39583-21cut09:35:170
301798100,5rtkit-daemon242566-21df_inode12:15:140
301798100,3rtkit-daemon636-21snmpd08:48:451
2346072101,6sleep2234732-21python312:05:222
1778262101,5sleep0177859-21apt-get11:25:140
9555291,4sleep29772-21users09:10:252
88013290,6sleep288181-21cut10:15:162
4152285291,6sleep04152403-21gltestperf08:35:130
4086739291,4sleep24086745-21lsb_release07:41:112
4063657291,2sleep00-21swapper/007:25:180
4033318290,5sleep30-21swapper/307:05:103
30179890,6rtkit-daemon492-21gmain09:18:100
30179890,6rtkit-daemon4046069-21munin-node12:33:410
30179890,5rtkit-daemon4112529-21taskset08:01:441
30179890,5rtkit-daemon317-21systemd-udevd11:17:330
30179890,4rtkit-daemon86543-21ntp_states10:10:190
30179890,4rtkit-daemon448-21wpa_supplicant07:37:561
30179890,4rtkit-daemon4128225-21tr08:15:191
30179890,3rtkit-daemon430-21avahi-daemon11:42:460
30179890,1rtkit-daemon0-21swapper/010:31:190
228090291,5sleep1228145-21ntp_states12:00:201
110082290,7sleep1112005-21sed10:30:171
87840280,6sleep188012-21gltestperf10:15:151
68385280,4sleep168417-21apt-get10:00:131
60797281,4sleep260867-21ntp_states09:50:202
49179281,4sleep049335-21diskstats09:45:130
4181478280,5sleep24183194-21/usr/sbin/munin08:55:192
4055157280,5sleep24055246-21irqcore07:20:162
30179880,5rtkit-daemon636-21snmpd07:57:261
30179880,5rtkit-daemon492-21gmain09:56:260
30179880,5rtkit-daemon3205-21sendmail-mta11:34:420
30179880,5rtkit-daemon3205-21sendmail-mta08:59:121
30179880,5rtkit-daemon3205-21sendmail-mta07:25:071
30179880,4rtkit-daemon667-21lldpd12:36:170
30179880,4rtkit-daemon667-21lldpd11:38:360
30179880,4rtkit-daemon667-21lldpd07:13:321
30179880,4rtkit-daemon638-21ntpd09:28:470
30179880,4rtkit-daemon636-21snmpd10:20:220
30179880,4rtkit-daemon636-21snmpd07:21:061
30179880,4rtkit-daemon492-21gmain12:10:540
30179880,4rtkit-daemon448-21wpa_supplicant12:28:300
30179880,4rtkit-daemon448-21wpa_supplicant11:56:280
30179880,4rtkit-daemon448-21wpa_supplicant07:51:061
30179880,4rtkit-daemon430-21avahi-daemon12:21:190
30179880,4rtkit-daemon430-21avahi-daemon12:02:190
30179880,4rtkit-daemon430-21avahi-daemon10:56:520
30179880,4rtkit-daemon4132841-21apt-get08:20:111
30179880,4rtkit-daemon4106313-21kworker/0:0+kacpid11:23:250
30179880,4rtkit-daemon4046069-21munin-node11:08:340
30179880,4rtkit-daemon4046069-21munin-node09:20:220
30179880,4rtkit-daemon4046069-21munin-node09:06:081
30179880,4rtkit-daemon4046069-21munin-node08:43:371
30179880,4rtkit-daemon4046069-21munin-node08:30:021
30179880,4rtkit-daemon29651-21apt-get09:30:130
30179880,4rtkit-daemon158780-21df11:10:130
30179880,4rtkit-daemon120427-21hddtemp_smartct10:40:140
30179880,3rtkit-daemon4141883-21kthreadcore08:25:181
30179880,3rtkit-daemon4048355-21apt-get07:15:131
30179880,1rtkit-daemon0-21swapper/108:50:151
30179880,1rtkit-daemon0-21swapper/107:30:151
30179880,1rtkit-daemon0-21swapper/009:51:540
30179880,1rtkit-daemon0-21swapper/007:05:360
25213281,4sleep127321-21cut09:25:191
165006281,4sleep1165039-21apt-get11:15:131
139277281,4sleep1139427-21df_inode10:55:141
138399281,4sleep0138616-21users10:50:240
105736281,4sleep2105794-21ntp_states10:25:222
4407270,4sleep15108-21sed09:10:161
4162246270,4sleep04163675-21memory08:40:180
4126407270,4sleep04126550-21df08:15:140
4126111270,4sleep24126118-21idleruntime-cro08:15:002
4093736271,3sleep24093768-21apt-get07:50:122
4088775270,4sleep04090009-21cat07:45:170
4078927271,3sleep04079182-21/usr/sbin/munin07:35:200
4056705271,4sleep04058795-21kthreadcore07:20:170
4049813270,4sleep24051769-21tr07:15:182
38642271,3sleep240821-21kthreadcore09:35:172
30179870,4rtkit-daemon667-21lldpd07:47:171
30179870,4rtkit-daemon638-21ntpd08:37:071
30179870,4rtkit-daemon3200908-21packagekitd11:51:000
30179870,3rtkit-daemon638-21ntpd11:47:280
30179870,3rtkit-daemon636-21snmpd08:08:411
30179870,3rtkit-daemon4187725-21kthreadcore09:00:171
30179870,3rtkit-daemon3205-21sendmail-mta07:40:161
30179870,3rtkit-daemon132224-21users10:45:240
265540270,4sleep2266795-21memory12:30:182
184251271,2sleep20-21swapper/211:30:122
178009270,4sleep2178076-21fschecks_count11:25:162
176743271,3sleep2176846-21mailstats11:20:232
172893270,4sleep1174547-21grep11:20:181
158634270,4sleep2158790-21diskstats11:10:132
146136271,4sleep2147132-21irqstats11:00:152
134819270,4sleep2136892-21tr10:50:182
120044271,3sleep20-21swapper/210:40:122
120026270,1sleep10-21swapper/110:40:111
87388260,3sleep287389-21cron10:15:002
67489261,3sleep167733-21users09:55:241
4187137261,2sleep00-21swapper/009:00:180
4166421261,2sleep20-21swapper/208:45:172
4140427260,3sleep24141676-21cut08:25:182
4105476260,3sleep20-21swapper/207:55:212
4061604261,2sleep20-21swapper/207:25:162
36089260,3sleep136236-21df09:35:131
3135260,1sleep00-21swapper/009:05:390
248462260,1sleep20-21swapper/212:18:452
236342261,2sleep20-21swapper/212:10:152
208631261,2sleep2208784-21needreboot11:45:192
202234260,1sleep10-21swapper/111:40:211
197744261,2sleep20-21swapper/211:40:182
15719261,2sleep20-21swapper/209:15:222
156966261,2sleep10-21swapper/111:05:191
126436260,3sleep1126469-21apt-get10:45:121
100476261,2sleep10-21swapper/110:25:131
94458250,2sleep10-21swapper/110:20:161
74747250,1sleep10-21swapper/110:05:011
69851250,2sleep20-21swapper/210:00:182
61980250,2sleep20-21swapper/209:55:132
55042250,1sleep20-21swapper/209:46:432
54982250,1sleep10-21swapper/109:45:581
43633250,3sleep144898-21cat09:40:171
4178065250,2sleep00-21swapper/008:55:130
4174138251,2sleep20-21swapper/208:50:182
4171640251,1sleep00-21swapper/008:50:120
4145282250,1sleep00-21swapper/008:28:320
4138772250,1sleep00-21swapper/008:22:150
4112783251,2sleep04113068-21gpgv08:05:000
4093476250,2sleep20-21swapper/207:50:002
4086431251,1sleep00-21swapper/007:41:090
4075457251,2sleep24076740-21kthreadcore07:35:182
4073667250,1sleep00-21swapper/007:33:590
4039319250,3sleep10-21swapper/107:08:441
30081250,2sleep20-21swapper/209:30:172
29093250,1sleep20-21swapper/209:26:362
255987250,2sleep1256862-21kthreadcore12:25:161
254669250,1sleep20-21swapper/212:20:492
251936250,3sleep1253919-21cat12:20:161
245464251,2sleep10-21swapper/112:15:191
241396251,1sleep10-21swapper/112:10:221
235266250,3sleep10-21swapper/112:08:021
224641250,2sleep20-21swapper/212:00:172
222281250,1sleep10-21swapper/111:56:521
216379250,2sleep20-21swapper/211:55:122
211852250,2sleep10-21swapper/111:50:201
191027250,3sleep1191213-21irqcore11:35:161
189693250,2sleep1189945-21unixbench_multi11:30:231
18831250,3sleep23973968-21kworker/2:2+events09:20:192
17817250,3sleep118828-21kthreadcore09:20:181
164411250,1sleep10-21swapper/111:10:401
158314250,1sleep20-21swapper/211:09:412
112697250,1sleep20-21swapper/210:30:312
11004250,3sleep111946-21cut09:15:171
94737240,1sleep20-21swapper/210:20:172
4184964240,2sleep20-21swapper/209:00:162
4171041240,3sleep00-21swapper/008:49:000
4152092240,2sleep20-21swapper/208:35:112
4151626240,3sleep00-21swapper/008:32:180
4138148240,2sleep20-21swapper/208:20:212
4125896240,3sleep00-21swapper/008:12:140
4099790240,3sleep00-21swapper/007:53:430
4038378240,1sleep20-21swapper/207:05:172
3421240,3sleep20-21swapper/209:09:172
270902240,2sleep20-21swapper/212:35:152
269537240,2sleep10-21swapper/112:35:141
260596240,2sleep20-21swapper/212:25:212
144582240,2sleep20-21swapper/210:55:242
127418240,2sleep20-21swapper/210:45:172
81513230,1sleep10-21swapper/110:10:141
74984230,1sleep20-21swapper/210:05:142
4159195230,1sleep20-21swapper/208:40:162
4145857230,1sleep20-21swapper/208:30:152
4130828230,1sleep20-21swapper/208:15:202
4114758230,1sleep00-21swapper/008:05:170
4105639230,1sleep00-21swapper/007:55:230
34699230,1sleep134871-21strings09:30:201
263459230,1sleep10-21swapper/112:30:181
210167230,1sleep20-21swapper/211:50:162
206684230,1sleep10-21swapper/111:45:181
177862230,1sleep10-21swapper/111:25:151
166464230,1sleep20-21swapper/211:15:182
150643230,1sleep10-21swapper/111:00:181
132594230,1sleep10-21swapper/110:50:011
113606230,1sleep10-21swapper/110:35:141
55543220,1sleep10-21swapper/109:50:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional