You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 10:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot8s.osadl.org (updated Mon Dec 29, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
41215349911550,1151cyclictest9462sleep320:05:013
4121534992421,1cyclictest0-21swapper/323:10:003
4121534992320,1cyclictest0-21swapper/321:15:013
3430692181,5sleep0343223-21if_err_eno100:30:160
2468692180,8sleep2248758-21cut23:15:182
4121534991612,2cyclictest71322-21turbostat21:00:013
1949952160,6sleep014-21ksoftirqd/022:35:160
4121534991512,1cyclictest0-21swapper/323:25:453
4121534991512,1cyclictest0-21swapper/322:25:003
4121534991512,1cyclictest0-21swapper/320:30:243
4121534991512,1cyclictest0-21swapper/319:44:313
4121534991512,1cyclictest0-21swapper/300:00:003
412153499151,11cyclictest97714-21taskset21:20:023
412153499151,11cyclictest57430-21taskset20:45:203
412153499151,11cyclictest225911-21turbostat23:00:013
412153499151,11cyclictest161899-21taskset22:10:143
412153499151,10cyclictest199607-21taskset22:35:233
412153499150,12cyclictest4156103-21taskset19:34:593
977282141,4sleep197760-21apt-get21:20:121
412153499144,6cyclictest3222512sleep300:10:243
412153499143,8cyclictest4169328-21taskset19:45:143
412153499141,9cyclictest71616-21taskset21:00:153
4121534991413,0cyclictest0-21swapper/321:58:503
4121534991413,0cyclictest0-21swapper/319:37:103
4121534991413,0cyclictest0-21swapper/300:34:113
4121534991413,0cyclictest0-21swapper/300:27:123
4121534991412,1cyclictest0-21swapper/322:29:123
4121534991412,1cyclictest0-21swapper/319:11:583
4121534991412,0cyclictest0-21swapper/320:27:173
4121534991412,0cyclictest0-21swapper/319:55:273
412153499141,11cyclictest213323-21taskset22:50:013
4121534991411,1cyclictest0-21swapper/323:32:533
4121534991411,1cyclictest0-21swapper/323:22:073
4121534991411,1cyclictest0-21swapper/323:15:573
4121534991411,1cyclictest0-21swapper/323:00:193
4121534991411,1cyclictest0-21swapper/322:15:193
4121534991411,1cyclictest0-21swapper/322:15:193
4121534991411,1cyclictest0-21swapper/322:00:133
4121534991411,1cyclictest0-21swapper/321:05:203
4121534991411,1cyclictest0-21swapper/320:53:083
4121534991411,1cyclictest0-21swapper/319:50:513
412153499141,10cyclictest4188489-21taskset20:00:133
412153499141,10cyclictest329682-21taskset00:20:013
412153499141,10cyclictest296380-21chrt23:50:323
412153499141,10cyclictest142325-21taskset21:55:003
412153499141,10cyclictest127623-21taskset21:40:183
1798122141,10sleep1179992-21cut22:20:181
412153499139,2cyclictest2842082sleep323:45:153
412153499134,7cyclictest135813-21taskset21:48:473
412153499133,7cyclictest239439-21taskset23:10:173
412153499131,9cyclictest46444-21taskset20:40:153
412153499131,9cyclictest4136729-21taskset19:20:023
412153499131,9cyclictest315214-21taskset00:05:183
412153499131,9cyclictest192731-21taskset22:30:183
412153499131,9cyclictest192731-21taskset22:30:173
412153499131,9cyclictest155434-21chrt22:05:023
4121534991312,0cyclictest0-21swapper/322:45:113
4121534991312,0cyclictest0-21swapper/300:00:043
4121534991311,1cyclictest0-21swapper/321:27:213
4121534991311,1cyclictest0-21swapper/320:14:353
412153499131,10cyclictest45534-21taskset20:38:143
4121534991310,1cyclictest0-21swapper/320:16:113
412153499130,11cyclictest116955-21taskset21:35:013
412153499130,10cyclictest4128353-21taskset19:15:003
412153499130,10cyclictest26066-21taskset20:20:403
412153499130,10cyclictest115796-21chrt21:30:193
412153499124,6cyclictest4143429-21taskset19:25:033
412153499121,9cyclictest97296-21taskset21:18:013
412153499121,9cyclictest283850-21taskset23:44:113
4121534991210,1cyclictest0-21swapper/300:35:093
412153499120,10cyclictest277227-21chrt23:36:533
412153499120,10cyclictest200495-21taskset22:40:033
301798120,7rtkit-daemon138993-21grep21:50:192
1554832121,4sleep2155629-21df22:05:142
41429222111,7sleep04143317-21dpkg19:25:000
412153499110,9cyclictest323223-21taskset00:15:043
3538722111,7sleep1354324-21grep00:35:221
301798110,6rtkit-daemon322133-21ntp_states00:10:222
301798110,6rtkit-daemon252266-21df_inode23:20:142
301798110,4rtkit-daemon4128035-21munin-node22:21:042
301798110,4rtkit-daemon4128035-21munin-node21:59:412
2792032110,9sleep2280714-21tr23:40:182
2130792111,7sleep1297-21systemd-journal22:50:001
2066892111,7sleep2206732-21munin-run22:45:002
846612101,2sleep00-21swapper/021:10:140
615942100,1sleep263779-21kthreadcore20:50:162
41873582101,5sleep24187483-21python319:55:242
3427662100,5sleep1342799-21apt-get00:30:141
3425492100,1sleep10-21swapper/100:30:011
301798100,5rtkit-daemon448-21wpa_supplicant23:30:272
2280132101,3sleep1229299-21kthreadcore23:00:221
1876202100,1sleep0187682-21cpuspeed_turbos22:30:120
1876202100,1sleep0187682-21cpuspeed_turbos22:30:110
99184291,6sleep2100837-21tr21:20:182
90781291,5sleep291117-21apt-config21:15:012
84686291,6sleep184841-21diskstats21:10:151
703291,5sleep1730-21awk20:04:591
55581290,6sleep257429-21sed20:45:202
44389291,5sleep044736-21tail20:35:210
4115260291,3sleep20-21swapper/219:05:102
30179890,6rtkit-daemon492-21gmain00:22:152
30179890,5rtkit-daemon636-21snmpd23:08:092
30179890,5rtkit-daemon636-21snmpd21:01:072
30179890,5rtkit-daemon448-21wpa_supplicant20:23:582
30179890,5rtkit-daemon4162113-21vmstat19:35:242
30179890,5rtkit-daemon317-21systemd-udevd00:31:332
30179890,4rtkit-daemon636-21snmpd20:26:322
30179890,4rtkit-daemon4142938-21apt-get19:25:012
30179890,4rtkit-daemon329416-21taskset00:19:582
30179890,4rtkit-daemon297-21systemd-journal23:59:552
30179890,4rtkit-daemon239603-21sed23:10:172
30179890,2rtkit-daemon0-21swapper/222:53:192
30179890,1rtkit-daemon0-21swapper/220:59:192
4180816281,4sleep14180893-21ntp_states19:50:221
4156316281,3sleep14156348-21apt-get19:35:111
4115296281,4sleep30-21swapper/319:05:123
30179880,5rtkit-daemon492-21gmain00:01:582
30179880,5rtkit-daemon3205-21sendmail-mta22:49:092
30179880,5rtkit-daemon0-21swapper/223:50:262
30179880,4rtkit-daemon636-21snmpd21:15:082
30179880,4rtkit-daemon636-21snmpd20:31:272
30179880,4rtkit-daemon636-21snmpd20:15:482
30179880,4rtkit-daemon492-21gmain20:09:032
30179880,4rtkit-daemon448-21wpa_supplicant21:33:002
30179880,4rtkit-daemon448-21wpa_supplicant21:06:192
30179880,4rtkit-daemon441-21rsyslogd21:40:142
30179880,4rtkit-daemon4164526-21cut19:40:192
30179880,4rtkit-daemon4128035-21munin-node23:26:312
30179880,4rtkit-daemon4128035-21munin-node22:39:262
30179880,4rtkit-daemon4128035-21munin-node22:15:322
30179880,4rtkit-daemon4128035-21munin-node22:15:322
30179880,4rtkit-daemon4128035-21munin-node21:38:582
30179880,4rtkit-daemon4128035-21munin-node19:50:172
30179880,4rtkit-daemon4128035-21munin-node19:49:122
30179880,4rtkit-daemon4128035-21munin-node19:24:072
30179880,4rtkit-daemon4128035-21munin-node19:16:362
30179880,4rtkit-daemon3205-21sendmail-mta21:47:182
30179880,4rtkit-daemon3205-21sendmail-mta20:03:592
30179880,4rtkit-daemon3200908-21packagekitd20:14:402
30179880,1rtkit-daemon0-21swapper/222:00:012
277747281,4sleep1277780-21apt-get23:40:131
221208281,5sleep2222556-21cut22:55:212
208877281,5sleep0210899-21grep22:45:190
20625280,6sleep121146-21cut20:20:191
168266280,5sleep00-21swapper/022:15:140
168266280,5sleep00-21swapper/022:15:140
161874280,4sleep2161896-21apt-get22:10:142
128987280,5sleep0129173-21who21:40:240
74433270,5sleep076594-21kthreadcore21:00:210
4182030270,4sleep14182176-21df19:55:151
4163438270,4sleep04164313-21cut19:40:190
4155407272,2sleep24155644-21unixbench_singl19:30:232
4125896270,4sleep14126843-21memory19:10:191
4117108270,4sleep04119163-21cut19:05:170
39549270,4sleep239695-21df20:35:152
342247271,4sleep0342548-21gpgv00:30:010
33502271,4sleep034114-21cut20:30:160
310108270,3sleep0310140-21apt-get00:05:120
30179870,4rtkit-daemon636-21snmpd19:10:342
30179870,4rtkit-daemon636-21snmpd00:25:402
30179870,3rtkit-daemon638-21ntpd22:30:022
30179870,3rtkit-daemon638-21ntpd22:30:022
30179870,3rtkit-daemon638-21ntpd22:25:082
30179870,3rtkit-daemon638-21ntpd20:41:112
30179870,3rtkit-daemon636-21snmpd23:35:192
30179870,3rtkit-daemon636-21snmpd00:08:052
30179870,3rtkit-daemon4128035-21munin-node23:46:062
30179870,3rtkit-daemon4128035-21munin-node00:35:362
30179870,3rtkit-daemon3205-21sendmail-mta23:02:442
115946270,5sleep1110555-21/usr/sbin/munin21:30:231
105130271,3sleep2106250-21kthreadcore21:25:192
97244260,1sleep00-21swapper/021:17:240
70618260,3sleep170850-21grep20:55:251
6809260,1sleep00-21swapper/020:06:080
6527261,3sleep16743-21users20:05:241
609260,1sleep00-21swapper/020:04:140
4181994260,3sleep04182027-21apt-get19:55:140
4169143261,2sleep10-21swapper/119:45:121
4164314260,4sleep14166333-21cut19:40:201
4145099260,3sleep10-21swapper/119:25:181
4138198261,2sleep14138233-21kthreadcore19:20:161
351733261,2sleep00-21swapper/000:35:210
316809261,2sleep0316842-21apt-get00:10:130
304632260,4sleep1305668-21grep00:00:151
303409261,2sleep0303442-21apt-get00:00:110
291026261,2sleep10-21swapper/123:50:191
271298261,2sleep10-21swapper/123:35:111
27056260,4sleep127451-21cut20:25:151
225885260,1sleep00-21swapper/023:00:010
204293260,3sleep1205654-21memory22:40:181
195857260,4sleep1197878-21cut22:35:181
189608260,3sleep1191661-21kthreadcore22:30:171
189608260,3sleep1191661-21kthreadcore22:30:171
174948261,3sleep0175088-21head22:20:130
167253260,3sleep0167365-21wc22:10:250
136568261,2sleep00-21swapper/021:50:170
109601260,4sleep0109736-21timerandwakeup21:25:250
103884260,3sleep0103897-21munin-run21:25:000
91298250,3sleep10-21swapper/121:15:121
7782251,2sleep10-21swapper/120:10:171
71190250,1sleep00-21swapper/020:58:360
60181251,2sleep10-21swapper/120:50:161
58727250,2sleep00-21swapper/020:50:110
53797251,2sleep10-21swapper/120:45:191
52814250,2sleep00-21swapper/020:45:180
51243250,3sleep051331-21run-parts20:40:200
45945250,1sleep10-21swapper/120:40:091
4175198251,2sleep0636-21snmpd19:48:410
4151371251,2sleep00-21swapper/019:30:180
4144197250,3sleep0221rcuc/019:25:170
39513250,2sleep10-21swapper/120:35:141
34116250,3sleep135249-21kthreadcore20:30:171
329079250,1sleep10-21swapper/100:15:421
32833250,1sleep00-21swapper/020:29:550
323418250,3sleep0323466-21fschecks_count00:15:130
303120250,2sleep1303272-21sed00:00:001
290069250,1sleep00-21swapper/023:46:490
264291250,1sleep10-21swapper/123:25:431
258097250,1sleep00-21swapper/023:23:130
25650250,3sleep025755-21switchtime20:20:260
252081250,2sleep10-21swapper/123:20:131
251419250,1sleep00-21swapper/023:18:280
238526250,1sleep10-21swapper/123:07:391
225206250,3sleep0225427-21unixbench_multi22:55:270
219754250,2sleep10-21swapper/122:55:161
214803251,2sleep00-21swapper/022:50:150
213527250,3sleep1213691-21expr22:50:121
206364250,3sleep00-21swapper/022:40:500
186569250,3sleep0186679-21cat22:25:230
181563251,2sleep184049-21kworker/u16:3+kvfree_rcu_reclaim22:25:161
169722250,3sleep1171248-21grep22:15:191
169722250,3sleep1171248-21grep22:15:191
155888250,3sleep1156828-21cut22:05:171
148622250,1sleep00-21swapper/021:58:350
148394250,1sleep10-21swapper/121:55:391
13969251,2sleep00-21swapper/020:15:170
137169250,3sleep1138173-21kthreadcore21:50:181
135845250,1sleep00-21swapper/021:49:120
135727250,1sleep10-21swapper/121:47:411
124395251,2sleep10-21swapper/121:40:171
119042250,3sleep0121126-21cut21:35:190
116550250,1sleep00-21swapper/021:32:540
82093240,2sleep10-21swapper/121:05:221
77381240,1sleep10-21swapper/121:00:461
4176538240,2sleep04177481-21kthreadcore19:50:170
4162197240,3sleep00-21swapper/019:36:270
4133153240,2sleep00-21swapper/019:15:190
4123825240,2sleep04125895-21kthreadcore19:10:180
4115458240,1sleep10-21swapper/119:05:131
331801240,2sleep1333871-21cut00:20:201
330696240,1sleep00-21swapper/000:20:190
316794240,3sleep10-21swapper/100:10:021
302303240,2sleep00-21swapper/023:55:230
296450240,3sleep00-21swapper/023:51:250
290221240,3sleep10-21swapper/123:48:471
282816240,2sleep0282988-21strings23:40:200
270753240,3sleep00-21swapper/023:31:190
259946240,2sleep0221rcuc/023:25:170
245075240,3sleep10-21swapper/123:14:251
240424240,2sleep0242055-21kthreadcore23:10:180
234009240,2sleep0235704-21kthreadcore23:05:180
155446240,3sleep00-21swapper/022:05:120
150992240,2sleep0152170-21kthreadcore22:00:180
110237240,3sleep10-21swapper/121:29:151
78152230,1sleep00-21swapper/021:05:180
4150072230,1sleep10-21swapper/119:30:151
4130279230,1sleep10-21swapper/119:15:121
309756230,1sleep10-21swapper/100:05:011
276367230,1sleep00-21swapper/023:35:180
265196230,1sleep10-21swapper/123:30:191
250618230,1sleep10-21swapper/123:15:211
161862230,1sleep10-21swapper/122:10:131
149264230,1sleep1149415-21smartctl22:00:161
13774230,1sleep10-21swapper/120:15:061
13278230,1sleep00-21swapper/020:11:490
117169230,1sleep10-21swapper/121:35:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional