You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 12:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot3.osadl.org (updated Sat Jul 12, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2524053991413,0cyclictest0-21swapper/323:00:233
2524053991413,0cyclictest0-21swapper/320:23:423
2524053991413,0cyclictest0-21swapper/300:20:153
2524053991313,0cyclictest0-21swapper/322:36:493
2524053991313,0cyclictest0-21swapper/321:54:503
2524053991313,0cyclictest0-21swapper/321:47:393
2524053991313,0cyclictest0-21swapper/300:25:213
2524053991312,0cyclictest0-21swapper/323:42:223
2524053991312,0cyclictest0-21swapper/323:35:113
2524053991312,0cyclictest0-21swapper/323:22:533
2524053991312,0cyclictest0-21swapper/322:16:203
2524053991312,0cyclictest0-21swapper/321:25:093
2524053991312,0cyclictest0-21swapper/319:50:553
2524053991310,1cyclictest0-21swapper/322:55:133
252405399130,11cyclictest0-21swapper/321:55:163
252405399121,9cyclictest69450irq/121-eno120:00:133
2524053991212,0cyclictest0-21swapper/323:15:433
2524053991212,0cyclictest0-21swapper/323:14:433
2524053991212,0cyclictest0-21swapper/322:49:073
2524053991212,0cyclictest0-21swapper/322:45:003
2524053991212,0cyclictest0-21swapper/321:41:313
2524053991212,0cyclictest0-21swapper/321:39:293
2524053991212,0cyclictest0-21swapper/321:13:533
2524053991212,0cyclictest0-21swapper/320:46:143
2524053991212,0cyclictest0-21swapper/320:37:013
2524053991212,0cyclictest0-21swapper/320:37:003
2524053991212,0cyclictest0-21swapper/319:56:033
2524053991212,0cyclictest0-21swapper/319:40:423
2524053991212,0cyclictest0-21swapper/319:26:203
2524053991211,0cyclictest0-21swapper/319:10:593
2524053991211,0cyclictest0-21swapper/300:00:133
252405399120,11cyclictest69450irq/121-eno100:05:443
252405399120,11cyclictest0-21swapper/323:45:013
252405399120,11cyclictest0-21swapper/319:30:183
2524053991111,0cyclictest69450irq/121-eno123:55:143
2524053991111,0cyclictest0-21swapper/323:30:123
2524053991111,0cyclictest0-21swapper/322:27:363
2524053991111,0cyclictest0-21swapper/322:05:133
2524053991111,0cyclictest0-21swapper/321:24:063
2524053991111,0cyclictest0-21swapper/300:35:373
252405399110,10cyclictest0-21swapper/320:50:123
252405399110,0cyclictest0-21swapper/320:05:203
252405399110,0cyclictest0-21swapper/319:15:203
252405399109,1cyclictest69450irq/121-eno122:50:153
252405399109,1cyclictest69450irq/121-eno100:10:133
252405399109,0cyclictest0-21swapper/319:45:153
2524053991010,0cyclictest0-21swapper/323:52:353
2524053991010,0cyclictest0-21swapper/323:29:033
2524053991010,0cyclictest0-21swapper/322:10:113
2524053991010,0cyclictest0-21swapper/320:44:103
2524053991010,0cyclictest0-21swapper/319:40:003
137398100,9rtkit-daemon545-21hwrng19:17:081
137398100,1rtkit-daemon2571303-21diskmemload00:34:461
25240539999,0cyclictest69450irq/121-eno122:31:183
25240539999,0cyclictest69450irq/121-eno120:55:203
25240539999,0cyclictest69450irq/121-eno100:15:203
25240539999,0cyclictest0-21swapper/321:30:193
25240539999,0cyclictest0-21swapper/321:00:143
25240539991,7cyclictest69450irq/121-eno119:20:123
25240539990,8cyclictest69450irq/121-eno100:30:163
25240539990,0cyclictest0-21swapper/321:15:133
2528714288,0sleep1545-21hwrng19:20:121
25240539988,0cyclictest69450irq/121-eno120:30:123
25240539988,0cyclictest69450irq/121-eno120:25:133
25240539988,0cyclictest0-21swapper/323:06:303
25240539988,0cyclictest0-21swapper/320:17:333
25240539988,0cyclictest0-21swapper/320:10:233
25240539977,0cyclictest0-21swapper/322:20:223
25240539977,0cyclictest0-21swapper/321:05:403
2522058271,4sleep30-21swapper/319:05:133
25240539963,1cyclictest0-21swapper/322:00:143
13739860,1rtkit-daemon2543552-21vmstat19:55:241
2523372253,0sleep00-21swapper/019:05:510
13739850,4rtkit-daemon2571303-21diskmemload23:02:521
13739850,3rtkit-daemon2652856-21/usr/sbin/munin00:20:151
13739850,2rtkit-daemon2508804-21munin-node19:05:181
13739850,0rtkit-daemon0-21swapper/120:55:171
2653977240,0sleep00-21swapper/000:22:370
2625703240,1sleep02625953-21users23:15:220
2523511242,1sleep20-21swapper/219:07:372
13739840,2rtkit-daemon2601372-21ntp_states22:20:181
13739840,2rtkit-daemon2560978-21mailstats20:40:201
13739840,1rtkit-daemon2525965-21munin-run19:15:001
13739840,0rtkit-daemon0-21swapper/122:56:251
2655019230,2sleep02655207-21grep00:25:190
2652415230,1sleep22652441-21apt-get00:20:122
2596397230,0sleep00-21swapper/022:10:140
2588827230,1sleep22588999-21python321:50:232
2552152230,2sleep12552278-21aten_r1power_vo20:20:151
2544191230,1sleep02544217-21apt-get20:00:140
13739830,2rtkit-daemon759-21lldpd00:10:331
13739830,2rtkit-daemon754-21snmpd00:36:481
13739830,2rtkit-daemon575-21rpcbind20:50:081
13739830,2rtkit-daemon435-21systemd-udevd23:41:551
13739830,2rtkit-daemon435-21systemd-udevd19:53:531
13739830,2rtkit-daemon2587783-21/usr/sbin/munin21:50:001
13739830,2rtkit-daemon2526186-21munin-node23:20:141
13739830,2rtkit-daemon2526186-21munin-node20:10:021
13739830,2rtkit-daemon1-21systemd23:51:191
13739830,2rtkit-daemon1-21systemd22:43:561
13739830,1rtkit-daemon754-21snmpd23:05:171
13739830,1rtkit-daemon754-21snmpd22:08:231
13739830,1rtkit-daemon754-21snmpd20:30:031
13739830,1rtkit-daemon754-21snmpd00:15:101
13739830,1rtkit-daemon677-21gmain22:31:411
13739830,1rtkit-daemon2613729-21aten2.4-expect22:50:151
13739830,1rtkit-daemon2598513-21apt-get22:15:151
13739830,1rtkit-daemon2571303-21diskmemload22:04:381
13739830,1rtkit-daemon2526186-21munin-node21:26:241
13739830,1rtkit-daemon1377-21sendmail-mta21:55:171
13739830,1rtkit-daemon1-21systemd23:30:521
13739830,1rtkit-daemon1-21systemd23:29:071
13739830,1rtkit-daemon1-21systemd21:10:171
13739830,1rtkit-daemon1-21systemd20:00:211
13739830,1rtkit-daemon1-21systemd00:25:441
13739830,0rtkit-daemon0-21swapper/122:37:111
2649265220,0sleep00-21swapper/000:10:220
2646757220,1sleep02646906-21ntp_states00:05:160
2636974220,1sleep22636997-21apt-get23:45:012
2632606221,1sleep00-21swapper/023:33:310
2630943220,0sleep20-21swapper/223:30:122
2629119220,1sleep02629302-21fw_packets23:25:140
2623323220,0sleep00-21swapper/023:10:210
2621749220,1sleep00-21swapper/023:07:210
2619577220,1sleep00-21swapper/023:01:370
2615036222,0sleep00-21swapper/022:50:530
2612081220,1sleep12612236-21sed22:45:171
2605829220,1sleep02605997-21mailstats22:30:180
2604517220,1sleep22604533-21apt-get22:30:012
2604465220,1sleep00-21swapper/022:29:340
2603203220,1sleep22603412-21ntpq22:25:162
2601040220,1sleep20-21swapper/222:20:172
2593649220,0sleep00-21swapper/022:01:290
2586679220,1sleep22586756-21ls21:45:182
2581240220,0sleep00-21swapper/021:34:230
2565809220,1sleep02565930-21aten2.4-expect20:55:120
2561963220,1sleep12561989-21apt-get20:45:141
2560052220,1sleep20-21swapper/220:40:142
2552123220,1sleep00-21swapper/020:20:140
2551794220,0sleep00-21swapper/020:19:180
2541928220,0sleep0491rcuog/219:53:570
2535994220,0sleep10-21swapper/119:40:011
2533201220,1sleep22533371-21mailstats19:30:182
2525246220,1sleep02525449-21grep19:10:180
13739820,1rtkit-daemon756-21ntpd21:50:191
13739820,1rtkit-daemon754-21snmpd21:40:251
13739820,1rtkit-daemon677-21gmain23:45:331
13739820,1rtkit-daemon677-21gmain00:02:091
13739820,1rtkit-daemon609-21systemd-logind20:16:531
13739820,1rtkit-daemon2526186-21munin-node20:07:161
13739820,1rtkit-daemon1-21systemd23:15:071
13739820,1rtkit-daemon1-21systemd21:35:021
13739820,1rtkit-daemon1-21systemd19:36:041
13739820,1rtkit-daemon1-21systemd19:30:121
13739820,0rtkit-daemon328-21plymouthd23:55:181
13739820,0rtkit-daemon328-21plymouthd22:26:561
13739820,0rtkit-daemon328-21plymouthd22:10:041
13739820,0rtkit-daemon0-21swapper/123:35:151
13739820,0rtkit-daemon0-21swapper/123:10:211
13739820,0rtkit-daemon0-21swapper/121:30:201
13739820,0rtkit-daemon0-21swapper/121:20:051
13739820,0rtkit-daemon0-21swapper/121:15:221
13739820,0rtkit-daemon0-21swapper/121:05:041
13739820,0rtkit-daemon0-21swapper/121:00:081
13739820,0rtkit-daemon0-21swapper/120:35:391
13739820,0rtkit-daemon0-21swapper/120:35:391
13739820,0rtkit-daemon0-21swapper/120:25:131
13739820,0rtkit-daemon0-21swapper/119:45:011
13739820,0rtkit-daemon0-21swapper/119:25:261
13739820,0rtkit-daemon0-21swapper/100:05:471
2659118210,0sleep20-21swapper/200:35:172
2658664210,0sleep00-21swapper/000:35:070
2657909210,0sleep00-21swapper/000:30:300
2656777210,0sleep20-21swapper/200:30:162
2655815210,0sleep20-21swapper/200:25:242
2651696210,0sleep00-21swapper/000:16:050
2649669210,0sleep20-21swapper/200:11:392
2647030210,0sleep20-21swapper/200:05:182
2644046210,0sleep00-21swapper/000:00:120
2643769210,0sleep20-21swapper/200:00:022
2643001210,0sleep00-21swapper/023:55:410
2642196210,0sleep20-21swapper/223:55:192
2641135210,0sleep20-21swapper/223:52:382
2640890210,0sleep00-21swapper/023:50:270
2637489210,0sleep02637515-21apt-get23:45:120
2635139210,0sleep00-21swapper/023:40:110
2634868210,0sleep20-21swapper/223:40:022
2633484210,0sleep20-21swapper/223:35:212
2633036210,0sleep00-21swapper/023:35:140
2630571210,0sleep20-21swapper/223:29:012
2626766210,0sleep20-21swapper/223:20:122
2626755210,0sleep00-21swapper/023:20:060
2624814210,0sleep20-21swapper/223:15:162
2621960210,0sleep20-21swapper/223:09:112
2618996210,0sleep20-21swapper/223:00:192
2614570210,0sleep20-21swapper/222:50:222
2613085210,0sleep20-21swapper/222:47:062
2612932210,0sleep00-21swapper/022:45:430
2610847210,0sleep20-21swapper/222:40:452
2610023210,0sleep00-21swapper/022:40:190
2606875210,1sleep20-21swapper/222:35:012
2601985210,0sleep00-21swapper/022:21:070
2598657210,0sleep00-21swapper/022:15:170
2598487210,0sleep20-21swapper/222:15:152
2596500210,0sleep20-21swapper/222:10:152
2595107210,0sleep20-21swapper/222:05:202
2594056210,0sleep00-21swapper/022:05:010
2592221210,0sleep20-21swapper/222:00:152
2590272210,0sleep20-21swapper/221:55:182
2589856210,1sleep00-21swapper/021:55:010
2588019210,0sleep00-21swapper/021:50:120
2585927210,0sleep00-21swapper/021:45:080
2584139210,0sleep22571303-21diskmemload21:40:182
2583845210,0sleep00-21swapper/021:40:160
2583186210,1sleep00-21swapper/021:38:470
2581813210,0sleep20-21swapper/221:35:172
2579294210,0sleep20-21swapper/221:29:582
2577565210,0sleep00-21swapper/021:25:150
2577253210,0sleep00-21swapper/021:24:260
2576610210,0sleep20-21swapper/221:20:242
2574724210,0sleep00-21swapper/021:15:230
2574328210,0sleep20-21swapper/221:15:202
2573145210,0sleep00-21swapper/021:13:340
2571981210,0sleep20-21swapper/221:10:162
2570597210,0sleep20-21swapper/221:05:192
2570345210,0sleep00-21swapper/021:05:170
2568151210,0sleep00-21swapper/021:00:180
2566208210,0sleep20-21swapper/220:55:142
2563995210,0sleep20-21swapper/220:50:142
2563392210,0sleep20-21swapper/220:47:032
2560040210,1sleep00-21swapper/020:40:040
2558405210,0sleep00-21swapper/020:35:160
2558405210,0sleep00-21swapper/020:35:150
2556045210,0sleep20-21swapper/220:30:132
2555330210,0sleep20-21swapper/220:25:222
2554992210,0sleep00-21swapper/020:25:200
2552281210,0sleep20-21swapper/220:20:162
2550763210,0sleep20-21swapper/220:15:162
2549746210,0sleep00-21swapper/020:12:350
2548272210,0sleep20-21swapper/220:10:132
2547704210,0sleep20-21swapper/220:09:162
2546103210,0sleep00-21swapper/020:05:130
2544356210,0sleep20-21swapper/220:00:152
2543806210,0sleep00-21swapper/019:58:330
2541103210,0sleep20-21swapper/219:50:192
2538877210,0sleep20-21swapper/219:45:192
2538499210,0sleep00-21swapper/019:45:170
2537829210,0sleep20-21swapper/219:40:262
2536529210,0sleep00-21swapper/019:40:160
2535956210,0sleep20-21swapper/219:39:342
2532913210,0sleep00-21swapper/019:30:160
2531992210,0sleep00-21swapper/019:27:430
2531035210,0sleep20-21swapper/219:25:172
2529208210,0sleep00-21swapper/019:20:160
2526690210,1sleep00-21swapper/019:15:140
2650293200,0sleep20-21swapper/200:15:032
2622552200,0sleep20-21swapper/223:10:032
2615746200,0sleep00-21swapper/022:55:040
2615743200,0sleep20-21swapper/222:55:022
2607110200,0sleep00-21swapper/022:35:040
2579301200,0sleep20-21swapper/221:30:012
2567704200,0sleep20-21swapper/221:00:042
2563862200,0sleep00-21swapper/020:50:040
2561951200,0sleep00-21swapper/020:45:050
2557611200,0sleep20-21swapper/220:35:022
2557611200,0sleep20-21swapper/220:35:012
2555932200,0sleep00-21swapper/020:30:030
2542245200,0sleep20-21swapper/219:55:042
2534320200,0sleep00-21swapper/019:35:040
2528325200,0sleep20-21swapper/219:20:012
2525943200,0sleep20-21swapper/219:15:012
2524268200,0sleep20-21swapper/219:10:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional