You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 13:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Fri Apr 19, 2024 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
372082621130,2sleep30-21swapper/321:00:123
35931702970,2sleep10-21swapper/119:10:171
39613412670,1sleep20-21swapper/223:30:262
37615752370,2chrt0-21swapper/321:25:303
2358491290,8ptp4l164790irq/127-enp1s0-TxRx-023:50:123
2358491290,3ptp4l0-21swapper/323:55:113
2358491270,3ptp4l0-21swapper/319:15:113
2358491260,5ptp4l164790irq/127-enp1s0-TxRx-019:25:103
359111899253,3cyclictest471rcuog/222:30:120
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-000:27:583
37878682240,2sleep20-21swapper/221:45:002
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-022:51:113
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-022:07:553
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-021:57:293
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-020:20:253
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-019:10:023
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-022:34:083
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-021:51:123
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-021:20:493
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-000:30:563
2358491240,3ptp4l0-21swapper/319:30:133
406538322319,2sleep20-21swapper/200:35:282
405056822319,2sleep20-21swapper/200:27:502
401782922319,2sleep20-21swapper/200:06:302
401024222319,2sleep20-21swapper/200:02:182
400223022319,2sleep20-21swapper/223:57:282
398665522319,2sleep20-21swapper/223:48:062
393859122319,2sleep20-21swapper/223:17:442
392983122319,2sleep20-21swapper/223:11:072
392203422319,2sleep20-21swapper/223:07:022
391469422319,2sleep20-21swapper/223:03:172
390005422319,2sleep20-21swapper/222:55:112
389897822319,2sleep20-21swapper/222:53:472
389013322319,2sleep20-21swapper/222:47:062
388195922319,2sleep20-21swapper/222:41:492
386654022319,2sleep20-21swapper/222:32:432
385912822319,2sleep20-21swapper/222:28:512
384350622319,2sleep20-21swapper/222:19:412
382593122319,2sleep20-21swapper/222:06:312
381852822319,2sleep20-21swapper/222:02:372
377924422319,2sleep20-21swapper/221:38:572
377003522319,2sleep20-21swapper/221:31:272
376336622319,2sleep20-21swapper/221:28:592
375360422319,2sleep20-21swapper/221:20:282
374673122319,2sleep20-21swapper/221:17:292
370826322319,2sleep20-21swapper/220:46:102
361141422319,2sleep20-21swapper/219:25:152
360998822319,2sleep20-21swapper/219:20:292
3591118992320,2cyclictest3597604-21irqcore19:15:020
359066122318,3sleep20-21swapper/219:06:322
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-023:35:523
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-022:57:093
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-022:27:473
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-022:22:173
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-022:19:463
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-022:10:033
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-000:39:493
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-000:19:133
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-000:12:533
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-000:06:143
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-000:02:073
405785222218,2sleep20-21swapper/200:31:282
399514022218,2sleep20-21swapper/223:54:082
397759922218,2sleep20-21swapper/223:40:542
397095122218,2sleep20-21swapper/223:38:282
383414322218,2sleep20-21swapper/222:11:592
380993622219,2sleep20-21swapper/221:56:292
380194122218,2sleep20-21swapper/221:51:272
372595522219,2sleep20-21swapper/221:03:372
368534522219,2sleep20-21swapper/220:27:062
367403022219,2sleep20-21swapper/220:19:262
363942922219,2sleep20-21swapper/219:50:072
3591119992220,1cyclictest3650854-21turbostat20:00:001
3591119992215,6cyclictest0-21swapper/121:10:021
3591118992218,3cyclictest1464-21dbus-daemon19:40:010
2358491220,6ptp4l164790irq/127-enp1s0-TxRx-021:36:343
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-023:28:553
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-023:31:523
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-023:00:423
2358491220,4ptp4l0-21swapper/323:10:113
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-023:23:363
2358491220,2ptp4l0-21swapper/321:41:353
2358491220,1ptp4l0-21swapper/300:24:423
371974122118,2sleep20-21swapper/220:56:172
369106122118,2sleep20-21swapper/220:31:592
367966022118,2sleep20-21swapper/220:22:532
36696492210,3sleep0471rcuog/220:15:170
365670722118,2sleep20-21swapper/220:03:062
365052722118,2sleep20-21swapper/219:56:132
363893422118,2sleep20-21swapper/219:47:442
363306422118,2sleep20-21swapper/219:41:092
361644522118,2sleep20-21swapper/219:30:112
3591119992119,1cyclictest3748310-21wc21:20:021
3591119992118,2cyclictest3943768-21kthreadcore23:20:191
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-020:02:463
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-023:15:583
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-022:47:163
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-019:55:553
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-019:23:383
2358491210,2ptp4l0-21swapper/322:40:313
2358491210,2ptp4l0-21swapper/321:05:263
2358491210,2ptp4l0-21swapper/320:12:363
3591119992017,2cyclictest3622596-21fschecks_count19:35:131
3591119992016,3cyclictest1464-21dbus-daemon21:05:011
3591118992017,2cyclictest3945071-21python323:20:250
3591118992017,2cyclictest3859882-21latency_hist22:30:010
3591118992017,2cyclictest3805409-21kthreadcore21:55:180
3591118992017,2cyclictest3773479-21kthreadcore21:35:180
3591118992016,3cyclictest3606134-21kthreadcore19:20:190
3591118992014,5cyclictest3743459-21kthreadcore21:15:200
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-022:02:133
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-019:40:503
2358491200,4ptp4l164790irq/127-enp1s0-TxRx-023:46:233
2358491200,4ptp4l164790irq/127-enp1s0-TxRx-020:49:513
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-021:48:363
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-021:31:513
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-021:17:013
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-021:11:533
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-020:55:223
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-020:15:503
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-020:05:213
2358491200,2ptp4l0-21swapper/323:40:143
3591120991916,1cyclictest0-21swapper/220:15:012
3591120991916,1cyclictest0-21swapper/219:15:002
3591119991916,2cyclictest4027753-21munin-plugin-st00:15:011
3591119991916,2cyclictest3939952-21cut23:20:011
3591119991916,2cyclictest3714318-21sh20:55:001
3591119991916,2cyclictest1464-21dbus-daemon19:55:011
3591118991916,2cyclictest4053334-21kthreadcore00:30:170
3591118991916,2cyclictest3903658-21kthreadcore22:55:190
3591118991916,2cyclictest3895792-21kthreadcore22:50:230
3591118991916,2cyclictest3753468-21unixbench-2d21:20:260
3591118991916,2cyclictest3717174-21kthreadcore20:55:210
3591118991916,2cyclictest3650984-21apt-key20:00:000
3591118991916,2cyclictest3611304-21cut19:25:120
3591118991915,3cyclictest3988685-21gltestperf23:50:150
3591118991915,3cyclictest3884591-21gltestperf22:45:130
3591118991915,3cyclictest3711436-21kthreadcore20:50:190
2358491190,4ptp4l164790irq/127-enp1s0-TxRx-020:51:363
2358491190,4ptp4l164790irq/127-enp1s0-TxRx-019:53:013
2358491190,3ptp4l164790irq/127-enp1s0-TxRx-022:38:453
2358491190,3ptp4l0-21swapper/320:35:133
2358491190,2ptp4l0-21swapper/320:30:243
3591120991815,1cyclictest0-21swapper/219:40:022
359111999186,2cyclictest3803825-21basename21:55:001
3591119991815,2cyclictest3987676-21munin-run23:50:001
3591119991815,2cyclictest3923637-21systemd-run23:10:001
3591119991815,2cyclictest3891921-21systemd22:50:011
3591119991815,2cyclictest3811828-21idleruntime-cro22:00:001
3591119991815,2cyclictest3708783-21systemd20:50:021
3591119991815,2cyclictest3674126-21cut20:20:001
3591119991815,2cyclictest3591039-21kworker/u8:0-flush-8:020:40:001
3591119991815,2cyclictest1-21systemd22:55:241
3591119991813,4cyclictest3752249-21kthreadcore21:20:191
3591119991812,5cyclictest0-21swapper/122:50:231
3591119991811,6cyclictest0-21swapper/122:00:131
3591118991815,2cyclictest4035907-21systemd-run00:20:010
3591118991815,2cyclictest4012574-21fschecks_time00:05:160
3591118991815,2cyclictest3999806-21kthreadcore23:55:190
3591118991815,2cyclictest3971989-21grep23:40:010
3591118991815,2cyclictest3957339-21kernelversion23:30:190
3591118991815,2cyclictest3924242-21acpi23:10:110
3591118991815,2cyclictest3917910-21kthreadcore23:05:190
3591118991815,2cyclictest3837309-21kthreadcore22:15:180
3591118991815,2cyclictest3727813-21kthreadcore21:05:210
3591118991815,2cyclictest3721590-21tr21:00:170
3591118991815,2cyclictest3639192-21latency_hist19:50:000
3591118991815,2cyclictest3591116-21cyclictest19:45:020
2358491180,6ptp4l164790irq/127-enp1s0-TxRx-023:05:113
2358491180,3ptp4l164790irq/127-enp1s0-TxRx-019:10:033
2358491180,2ptp4l0-21swapper/320:25:273
2358491180,2ptp4l0-21swapper/319:45:173
3591120991714,1cyclictest0-21swapper/219:20:012
3591119991714,2cyclictest3848718-21open_inodes22:20:201
3591119991714,2cyclictest3822375-21kthreadcore22:05:201
3591119991711,5cyclictest3883886-21latency_hist22:45:021
3591118991714,2cyclictest4006510-21kthreadcore00:00:180
3591118991714,2cyclictest3879569-21kthreadcore22:40:210
3591118991714,2cyclictest3868998-21irqcore22:35:170
3591118991714,2cyclictest3851994-21systemd-run22:25:020
3591118991714,2cyclictest3829613-21kthreadcore22:10:160
3591118991714,2cyclictest3812696-21fschecks_count22:00:160
3591118991714,2cyclictest3789044-21sed21:45:160
3591118991714,2cyclictest3787950-21cut21:45:010
3591118991714,2cyclictest3764838-21fschecks_time21:30:130
3591118991714,2cyclictest3705695-21kthreadcore20:45:220
3591118991714,2cyclictest3698550-21kthreadcore20:40:200
3591118991714,2cyclictest3698550-21kthreadcore20:40:190
2358491170,5ptp4l164790irq/127-enp1s0-TxRx-019:35:143
3591119991613,2cyclictest4067946-21systemd-run00:40:011
3591119991613,2cyclictest4036023-21runrttasks00:20:051
3591119991613,2cyclictest3998105-21kthreadcore23:55:181
3591119991613,2cyclictest3979778-21idleruntime-cro23:45:011
3591119991613,2cyclictest3949165-21tr23:25:141
3591119991613,2cyclictest3763915-21cron21:30:011
3591119991613,2cyclictest1464-21dbus-daemon23:55:011
3591119991613,2cyclictest0-21swapper/122:25:081
3591119991612,3cyclictest4016030-21kthreadcore00:05:221
3591119991612,3cyclictest4004952-21irqcore00:00:171
3591119991612,3cyclictest3735125-21kthreadcore21:10:211
3591119991612,3cyclictest3690775-21timerwakeupswit20:30:251
3591119991612,3cyclictest3618665-21kthreadcore19:30:211
3591119991612,3cyclictest3605011-21cpu19:20:121
3591118991614,1cyclictest4051712-21cron00:30:000
3591118991613,2cyclictest3951096-21kthreadcore23:25:160
3591118991613,2cyclictest3757714-21kthreadcore21:25:200
3591118991613,2cyclictest3737011-21missed_timers21:10:230
3591118991613,2cyclictest3679942-21latency_hist20:25:020
3591118991613,2cyclictest3662600-21dump-pmu-power20:10:000
3591118991613,2cyclictest1502-21systemd-logind20:15:020
3591118991613,2cyclictest0-21swapper/019:55:010
3591118991612,3cyclictest3983922-21kthreadcore23:45:220
2358491160,5ptp4l164790irq/127-enp1s0-TxRx-020:40:183
2358491160,5ptp4l164790irq/127-enp1s0-TxRx-020:40:173
359112099151,8cyclictest0-21swapper/220:05:112
3591120991513,1cyclictest0-21swapper/222:20:102
3591120991512,1cyclictest0-21swapper/223:26:332
3591120991512,1cyclictest0-21swapper/223:22:222
3591120991512,1cyclictest0-21swapper/200:20:502
359111999158,6cyclictest4028062-21/usr/sbin/munin00:15:181
359111999158,6cyclictest3780214-21acpi21:40:091
359111999158,2cyclictest0-21swapper/121:38:141
3591119991512,2cyclictest4053143-21irqrtprio00:30:161
3591119991512,2cyclictest3966316-21kthreadcore23:35:171
3591119991512,2cyclictest3926323-21kthreadcore23:10:181
3591119991512,2cyclictest3836674-21grep22:15:141
3591119991512,2cyclictest3719312-21mailstats20:55:261
3591119991512,2cyclictest3639122-21latency_hist19:50:001
3591119991512,2cyclictest3628071-21cpuspeed_turbos19:40:121
3591119991512,2cyclictest3600182-21irqrtprio19:15:161
3591119991512,2cyclictest0-21swapper/123:35:001
3591119991512,2cyclictest0-21swapper/122:40:001
3591119991511,3cyclictest4044679-21tail00:25:151
3591119991511,3cyclictest3910780-21kthreadcore23:00:191
3591119991511,3cyclictest3765388-21irqrtprio21:30:161
359111999150,7cyclictest481rcuop/220:05:101
359111899159,4cyclictest4063942-21tr00:35:200
359111899158,5cyclictest254-21systemd-journal20:32:160
3591118991513,1cyclictest0-21swapper/020:30:010
3591118991512,2cyclictest4036896-21irqcore00:20:140
3591118991512,2cyclictest3827858-21sh22:10:000
3591118991512,2cyclictest3798808-21kthreadcore21:50:180
3591118991511,3cyclictest3883673-21kworker/u8:4+nfsiod23:04:000
359111899150,4cyclictest3975505-21kthreadcore23:40:180
3591120991412,1cyclictest0-21swapper/222:40:032
3591120991411,1cyclictest0-21swapper/221:10:142
3591120991411,1cyclictest0-21swapper/220:50:172
3591120991411,1cyclictest0-21swapper/200:15:152
359111999143,9cyclictest1464-21dbus-daemon19:10:011
3591119991411,2cyclictest3862850-21kthreadcore22:30:191
3591119991410,3cyclictest254-21systemd-journal20:25:031
3591119991410,3cyclictest1454-1atopacctd20:40:141
3591119991410,3cyclictest1454-1atopacctd20:40:131
359111999140,7cyclictest481rcuop/222:11:151
3591118991411,2cyclictest3935100-21kthreadcore23:15:210
3591118991411,2cyclictest3653400-21kthreadcore20:00:190
3591118991411,2cyclictest3601965-21kthreadcore19:15:170
3591118991410,3cyclictest3787849-21kworker/u8:3+nfsiod00:12:270
3591120991311,1cyclictest0-21swapper/221:45:192
3591120991311,1cyclictest0-21swapper/221:05:142
359111999139,3cyclictest3789918-21kthreadcore21:45:191
359111999139,3cyclictest3683758-21kthreadcore20:25:161
3591119991310,2cyclictest3652515-21irqrtprio20:00:171
3591119991310,2cyclictest3612354-21kthreadcore19:25:181
3591118991311,1cyclictest0-21swapper/020:35:120
3591118991310,2cyclictest3616922-21fschecks_time19:30:160
359112099129,1cyclictest0-21swapper/220:40:202
359112099129,1cyclictest0-21swapper/220:40:202
3591120991210,1cyclictest0-21swapper/220:35:152
3591120991210,1cyclictest0-21swapper/200:10:182
359111999128,3cyclictest3664039-21kernelversion20:10:171
359111899108,1cyclictest0-21swapper/019:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional