You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-25 - 06:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot3.osadl.org (updated Sat Jan 25, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
326573699140,12cyclictest0-21swapper/321:35:113
3265736991311,1cyclictest0-21swapper/320:30:163
326573699130,11cyclictest0-21swapper/319:20:143
3265736991210,1cyclictest0-21swapper/323:35:143
3265736991210,1cyclictest0-21swapper/320:40:123
326573699120,11cyclictest0-21swapper/321:30:143
326573699120,11cyclictest0-21swapper/321:00:013
326573699120,11cyclictest0-21swapper/319:45:003
326573699119,1cyclictest0-21swapper/320:25:113
326573699115,1cyclictest0-21swapper/322:55:123
326573699110,10cyclictest0-21swapper/321:52:093
326573699110,0cyclictest0-21swapper/319:25:123
326573699110,0cyclictest0-21swapper/319:15:173
326573699109,0cyclictest0-21swapper/321:46:473
326573699109,0cyclictest0-21swapper/320:25:013
326573699109,0cyclictest0-21swapper/300:20:123
3265736991010,0cyclictest0-21swapper/323:55:173
3265736991010,0cyclictest0-21swapper/323:40:193
3265736991010,0cyclictest0-21swapper/323:25:023
3265736991010,0cyclictest0-21swapper/322:35:123
3265736991010,0cyclictest0-21swapper/321:05:133
326573699100,9cyclictest0-21swapper/300:10:073
326573699100,0cyclictest0-21swapper/322:00:013
326573699100,0cyclictest0-21swapper/300:05:013
32657369999,0cyclictest0-21swapper/322:19:503
32657369999,0cyclictest0-21swapper/320:00:233
32657369998,1cyclictest0-21swapper/319:30:173
32657369998,0cyclictest0-21swapper/321:15:163
32657369998,0cyclictest0-21swapper/319:55:163
32657369990,1cyclictest0-21swapper/319:50:143
32657369990,0cyclictest0-21swapper/323:10:083
32657369990,0cyclictest0-21swapper/319:10:153
32657369988,0cyclictest0-21swapper/323:50:013
32657369988,0cyclictest0-21swapper/323:20:183
32657369988,0cyclictest0-21swapper/322:20:253
32657369988,0cyclictest0-21swapper/321:20:013
32657369988,0cyclictest0-21swapper/320:15:083
32657369980,0cyclictest0-21swapper/300:15:193
3263908281,5sleep30-21swapper/319:05:133
32657369977,0cyclictest0-21swapper/323:30:013
32657369977,0cyclictest0-21swapper/323:05:013
32657369977,0cyclictest0-21swapper/322:50:073
32657369977,0cyclictest0-21swapper/322:40:133
32657369977,0cyclictest0-21swapper/322:29:543
32657369977,0cyclictest0-21swapper/320:50:133
32657369977,0cyclictest0-21swapper/320:35:133
32657369977,0cyclictest0-21swapper/319:35:173
32657369977,0cyclictest0-21swapper/300:35:173
32657369977,0cyclictest0-21swapper/300:25:403
32657369970,7cyclictest0-21swapper/300:35:013
32657369970,0cyclictest0-21swapper/322:10:073
3323358260,0sleep2441rcuc/221:40:172
32657369966,0cyclictest0-21swapper/320:10:193
32657369966,0cyclictest0-21swapper/319:45:123
32657369965,1cyclictest0-21swapper/323:15:123
32657369965,0cyclictest0-21swapper/322:49:513
32657369965,0cyclictest0-21swapper/322:31:573
32657369965,0cyclictest0-21swapper/300:05:233
32657369955,0cyclictest0-21swapper/323:50:103
32657369955,0cyclictest0-21swapper/322:00:143
32657369955,0cyclictest0-21swapper/321:40:153
32657369955,0cyclictest0-21swapper/321:28:053
32657369955,0cyclictest0-21swapper/321:11:063
32657369954,0cyclictest0-21swapper/321:00:133
3265293250,4sleep13265294-21sshd19:06:261
13989850,2rtkit-daemon0-21swapper/219:05:122
13989850,0rtkit-daemon0-21swapper/220:38:462
13989850,0rtkit-daemon0-21swapper/219:15:402
32657369944,0cyclictest0-21swapper/320:45:573
32657369944,0cyclictest0-21swapper/320:07:093
32657369943,0cyclictest0-21swapper/322:05:113
32657369940,3cyclictest3353190-21chrt23:06:503
3264587241,1sleep00-21swapper/019:05:180
13989840,2rtkit-daemon614-21wpa_supplicant23:29:252
13989840,2rtkit-daemon1-21systemd22:51:072
13989840,2rtkit-daemon1-21systemd22:11:022
13989840,2rtkit-daemon1-21systemd00:32:062
13989840,0rtkit-daemon0-21swapper/221:00:532
3361131230,2sleep23361157-21apt-get23:30:072
3359828230,1sleep03359848-21apt-get23:25:020
3265888230,2sleep03265913-21apt19:10:100
13989830,2rtkit-daemon762-21ntpd22:40:192
13989830,2rtkit-daemon760-21snmpd19:47:402
13989830,2rtkit-daemon600-21avahi-daemon22:21:412
13989830,2rtkit-daemon600-21avahi-daemon21:21:482
13989830,2rtkit-daemon3267798-21munin-node23:12:512
13989830,2rtkit-daemon3267798-21munin-node00:25:012
13989830,2rtkit-daemon1-21systemd23:20:162
13989830,2rtkit-daemon1-21systemd20:07:312
13989830,1rtkit-daemon762-21ntpd23:55:402
13989830,1rtkit-daemon760-21snmpd22:55:022
13989830,1rtkit-daemon760-21snmpd21:30:202
13989830,1rtkit-daemon760-21snmpd20:56:062
13989830,1rtkit-daemon614-21wpa_supplicant00:36:282
13989830,1rtkit-daemon331-21plymouthd23:40:382
13989830,1rtkit-daemon331-21plymouthd23:35:072
13989830,1rtkit-daemon331-21plymouthd23:02:482
13989830,1rtkit-daemon331-21plymouthd21:55:142
13989830,1rtkit-daemon331-21plymouthd21:48:342
13989830,1rtkit-daemon331-21plymouthd21:38:452
13989830,1rtkit-daemon331-21plymouthd20:25:112
13989830,1rtkit-daemon331-21plymouthd00:24:192
13989830,1rtkit-daemon3250660-21munin-node19:11:392
13989830,1rtkit-daemon1399-21sendmail-mta23:08:072
13989830,1rtkit-daemon1399-21sendmail-mta20:12:322
13989830,1rtkit-daemon1399-21sendmail-mta00:01:392
13989830,1rtkit-daemon1-21systemd23:50:382
13989830,1rtkit-daemon1-21systemd22:45:112
13989830,1rtkit-daemon1-21systemd22:32:142
13989830,1rtkit-daemon1-21systemd22:25:122
13989830,1rtkit-daemon1-21systemd22:16:132
13989830,1rtkit-daemon1-21systemd21:17:232
13989830,1rtkit-daemon1-21systemd21:11:082
13989830,1rtkit-daemon1-21systemd20:20:172
13989830,1rtkit-daemon1-21systemd19:42:322
13989830,1rtkit-daemon1-21systemd19:33:292
13989830,1rtkit-daemon1-21systemd19:20:302
13989830,1rtkit-daemon1-21systemd00:10:532
3384912220,1sleep03385158-21diskstats00:35:150
3381203220,0sleep00-21swapper/000:21:340
3381174220,1sleep10-21swapper/100:21:191
3378438220,1sleep13378612-21mailstats00:15:181
3374506220,0sleep00-21swapper/000:04:560
3372135220,1sleep00-21swapper/000:00:000
3355923220,1sleep03356063-21telnet23:15:130
3341167220,0sleep10-21swapper/122:32:161
3301496220,1sleep23301739-21cpuspeed_turbos20:40:142
3286430220,1sleep03286582-21ntpq20:00:200
3276940220,1sleep03277028-21pmu-power19:35:160
13989820,1rtkit-daemon762-21ntpd19:55:152
13989820,1rtkit-daemon760-21snmpd00:18:202
13989820,1rtkit-daemon614-21wpa_supplicant22:05:412
13989820,1rtkit-daemon331-21plymouthd20:46:282
13989820,1rtkit-daemon3267798-21munin-node22:35:072
13989820,1rtkit-daemon1-21systemd23:45:222
13989820,1rtkit-daemon1-21systemd23:15:152
13989820,1rtkit-daemon1-21systemd20:50:522
13989820,1rtkit-daemon1-21systemd20:30:142
13989820,1rtkit-daemon1-21systemd19:28:102
13989820,0rtkit-daemon331-21plymouthd21:51:372
13989820,0rtkit-daemon331-21plymouthd21:05:182
13989820,0rtkit-daemon331-21plymouthd20:16:062
13989820,0rtkit-daemon331-21plymouthd19:51:442
13989820,0rtkit-daemon331-21plymouthd19:35:142
13989820,0rtkit-daemon331-21plymouthd00:05:282
13989820,0rtkit-daemon0-21swapper/222:00:042
13989820,0rtkit-daemon0-21swapper/221:25:232
13989820,0rtkit-daemon0-21swapper/220:00:052
3385628210,0sleep10-21swapper/100:35:201
3384258210,0sleep00-21swapper/000:33:100
3383414210,1sleep1601-21dbus-daemon00:30:151
3382145210,0sleep10-21swapper/100:27:501
3382026210,1sleep00-21swapper/000:26:450
3377398210,0sleep00-21swapper/000:15:010
3377339210,1sleep1760-21snmpd00:14:301
3375558210,0sleep00-21swapper/000:10:090
3374514210,0sleep10-21swapper/100:05:021
3372669210,0sleep10-21swapper/100:00:051
3371792210,0sleep10-21swapper/123:57:011
3369869210,0sleep00-21swapper/023:53:280
3369611210,0sleep10-21swapper/123:51:091
3367886211,0sleep1351ktimers/123:49:201
3367494211,0sleep00-21swapper/023:45:500
3366181210,0sleep00-21swapper/023:40:190
3365324210,0sleep10-21swapper/123:40:081
3363224210,0sleep10-21swapper/123:35:121
3363024210,1sleep00-21swapper/023:35:030
3362847210,0sleep10-21swapper/123:33:561
3362461210,1sleep00-21swapper/023:30:300
3360380210,0sleep10-21swapper/123:25:351
3359540210,0sleep10-21swapper/123:22:301
3358725210,1sleep00-21swapper/023:20:170
3355634210,0sleep10-21swapper/123:15:021
3354580210,0sleep10-21swapper/123:10:141
3353820210,0sleep00-21swapper/023:10:090
3353364210,0sleep10-21swapper/123:08:251
3353229210,0sleep00-21swapper/023:07:130
3352249210,1sleep00-21swapper/023:00:360
3352236210,0sleep10-21swapper/123:00:291
3350392210,0sleep10-21swapper/122:57:491
3350352210,0sleep00-21swapper/022:57:270
3346718210,0sleep10-21swapper/122:50:091
3346068210,0sleep00-21swapper/022:46:280
3345979210,1sleep13345980-21sh22:45:411
3345137210,0sleep13345147-21ssh22:40:191
3344885210,0sleep00-21swapper/022:40:180
3343225210,0sleep00-21swapper/022:36:590
3340462210,0sleep00-21swapper/022:30:150
3339104210,0sleep10-21swapper/122:27:271
3338109210,1sleep00-21swapper/022:20:420
3337593210,0sleep10-21swapper/122:20:231
3336248210,0sleep10-21swapper/122:17:551
3334817210,0sleep00-21swapper/022:15:130
3331778210,0sleep10-21swapper/122:05:181
3331756210,0sleep00-21swapper/022:05:050
3329877210,0sleep00-21swapper/022:00:160
3328130210,0sleep10-21swapper/121:55:171
3328021210,0sleep00-21swapper/021:55:160
3325484210,0sleep00-21swapper/021:50:080
3324851210,0sleep00-21swapper/021:46:360
3324821210,0sleep10-21swapper/121:46:201
3324327210,0sleep10-21swapper/121:44:011
3323056210,0sleep00-21swapper/021:40:150
3321564210,0sleep00-21swapper/021:35:180
3318163210,0sleep10-21swapper/121:28:081
3318102210,1sleep00-21swapper/021:27:270
3316605210,0sleep00-21swapper/021:20:170
3314512210,0sleep00-21swapper/021:15:180
3313581210,0sleep10-21swapper/121:15:111
3311357210,0sleep00-21swapper/021:10:010
3310211210,0sleep00-21swapper/021:05:170
3307964210,0sleep00-21swapper/021:00:130
3306532210,0sleep00-21swapper/020:55:210
3306006210,0sleep10-21swapper/120:55:181
3304449210,0sleep00-21swapper/020:50:120
3303692210,0sleep10-21swapper/120:50:011
3303397210,1sleep00-21swapper/020:46:160
3302443210,0sleep00-21swapper/020:40:190
3302019210,0sleep10-21swapper/120:40:161
3299504210,0sleep00-21swapper/020:35:150
3298868210,0sleep00-21swapper/020:30:270
3298698210,0sleep10-21swapper/120:30:241
3296934210,0sleep10-21swapper/120:25:191
3296088210,0sleep00-21swapper/020:25:140
3293630210,0sleep00-21swapper/020:20:140
3291662210,0sleep00-21swapper/020:15:140
3290934210,0sleep00-21swapper/020:10:260
3288195210,0sleep03288337-21missed_timers20:05:130
3287738210,0sleep10-21swapper/120:05:101
3285935210,0sleep10-21swapper/120:00:181
3281964210,0sleep10-21swapper/119:50:141
3281717210,0sleep00-21swapper/019:50:010
3281334210,0sleep00-21swapper/019:45:190
3279080210,0sleep00-21swapper/019:40:240
3278147210,0sleep10-21swapper/119:40:171
3277033210,0sleep10-21swapper/119:35:171
3274301210,0sleep10-21swapper/119:30:151
3274290210,1sleep00-21swapper/019:30:070
3273426210,0sleep00-21swapper/019:25:270
3272119210,0sleep10-21swapper/119:25:121
3271751210,0sleep10-21swapper/119:23:281
3270242210,0sleep00-21swapper/019:20:140
3269136210,0sleep00-21swapper/019:15:180
3268717210,0sleep10-21swapper/119:15:151
3374753200,0sleep00-21swapper/000:05:050
3346707200,0sleep00-21swapper/022:50:040
3341722200,0sleep10-21swapper/122:35:041
3338632200,0sleep00-21swapper/022:25:020
3332549200,0sleep10-21swapper/122:10:021
3332317200,0sleep00-21swapper/022:10:010
3329410200,0sleep10-21swapper/122:00:011
3325480200,0sleep10-21swapper/121:50:051
3320577200,0sleep10-21swapper/121:35:041
3318574200,0sleep10-21swapper/121:30:041
3318573200,0sleep00-21swapper/021:30:030
3315842200,0sleep10-21swapper/121:20:021
3311593200,0sleep10-21swapper/121:10:021
3309678200,0sleep10-21swapper/121:05:011
3307768200,0sleep10-21swapper/121:00:021
3303069200,0sleep10-21swapper/120:45:011
3299462200,0sleep10-21swapper/120:35:041
3293464200,0sleep10-21swapper/120:20:031
3291527200,0sleep10-21swapper/120:15:031
3289617200,0sleep10-21swapper/120:10:031
3283861200,0sleep10-21swapper/119:55:021
3283626200,0sleep00-21swapper/019:55:010
3279806200,0sleep10-21swapper/119:45:001
3265879200,0sleep10-21swapper/119:10:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional