You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 13:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot3.osadl.org (updated Fri Apr 19, 2024 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32143799130,12cyclictest0-21swapper/310:05:113
32143799130,12cyclictest0-21swapper/308:15:123
32143799120,11cyclictest0-21swapper/312:35:133
32143799120,11cyclictest0-21swapper/308:05:113
32143799120,0cyclictest0-21swapper/307:35:123
321437991111,0cyclictest0-21swapper/312:30:023
321437991111,0cyclictest0-21swapper/310:00:123
321437991111,0cyclictest0-21swapper/308:35:103
32143799110,11cyclictest0-21swapper/307:20:213
32143799110,0cyclictest0-21swapper/309:00:143
32143799110,0cyclictest0-21swapper/307:50:143
321437991010,0cyclictest0-21swapper/311:30:133
321437991010,0cyclictest0-21swapper/311:19:563
321437991010,0cyclictest0-21swapper/309:55:193
321437991010,0cyclictest0-21swapper/308:20:113
32143799100,10cyclictest0-21swapper/311:00:003
32143799100,10cyclictest0-21swapper/309:50:213
3214379999,0cyclictest0-21swapper/312:25:113
3214379999,0cyclictest0-21swapper/312:24:073
3214379999,0cyclictest0-21swapper/312:00:003
3214379999,0cyclictest0-21swapper/308:55:213
3214379990,8cyclictest0-21swapper/309:20:243
3214379990,1cyclictest0-21swapper/307:25:093
3214379990,0cyclictest0-21swapper/310:40:203
3214379988,0cyclictest0-21swapper/310:25:133
3214379988,0cyclictest0-21swapper/308:30:123
3214379988,0cyclictest0-21swapper/308:10:123
3214379988,0cyclictest0-21swapper/307:45:103
3214379986,1cyclictest0-21swapper/310:10:123
3214379980,8cyclictest0-21swapper/311:20:223
3214379980,8cyclictest0-21swapper/310:50:013
3214379980,8cyclictest0-21swapper/309:45:203
3214379980,8cyclictest0-21swapper/309:35:183
3214379980,8cyclictest0-21swapper/307:15:203
3214379980,8cyclictest0-21swapper/307:10:193
13129880,3rtkit-daemon1-21systemd07:05:572
3214379977,0cyclictest0-21swapper/312:00:123
3214379977,0cyclictest0-21swapper/310:30:213
3214379977,0cyclictest0-21swapper/308:27:113
3214379966,0cyclictest0-21swapper/311:05:093
3214379966,0cyclictest0-21swapper/310:50:133
3214379966,0cyclictest0-21swapper/310:20:093
3214379966,0cyclictest0-21swapper/307:33:023
3214379960,6cyclictest0-21swapper/311:10:183
320502261,3sleep0320645-21timerandwakeup07:05:210
423005254,0sleep2423059-21systemctl11:20:012
3214379955,0cyclictest0-21swapper/312:10:203
3214379951,4cyclictest0-21swapper/309:05:203
3214379950,0cyclictest0-21swapper/307:55:103
321255250,2sleep30-21swapper/307:09:573
319573250,3sleep10-21swapper/107:05:021
13129850,0rtkit-daemon0-21swapper/208:50:212
13129850,0rtkit-daemon0-21swapper/207:31:352
344722240,0sleep1344938-21users08:05:211
3214379944,0cyclictest0-21swapper/309:15:123
3214379944,0cyclictest0-21swapper/309:11:523
3214379940,4cyclictest0-21swapper/312:05:113
3214379940,4cyclictest0-21swapper/311:02:543
3214379940,4cyclictest0-21swapper/308:45:133
3214379940,3cyclictest0-21swapper/311:46:043
3214379940,3cyclictest0-21swapper/307:43:163
3214379940,2cyclictest0-21swapper/312:15:133
3214379940,0cyclictest0-21swapper/308:00:183
13129840,2rtkit-daemon538-21systemd-logind09:49:302
13129840,2rtkit-daemon375-21systemd-udevd09:50:302
13129840,2rtkit-daemon356-21systemd-journal10:35:302
13129840,2rtkit-daemon356-21systemd-journal10:22:302
13129840,2rtkit-daemon356-21systemd-journal09:16:302
13129840,2rtkit-daemon323842-21python307:15:002
13129840,1rtkit-daemon717-21lldpd11:35:362
13129840,1rtkit-daemon364894-21apt-get09:00:132
443339230,1sleep1443477-21/usr/sbin/munin12:05:391
415447230,2sleep2415603-21/usr/sbin/munin11:00:202
398571230,1sleep1398742-21python310:20:171
384481230,2sleep1384528-21cat09:45:141
352740230,0sleep10-21swapper/108:26:191
344979230,0sleep20-21swapper/208:05:472
325901230,1sleep0325661-21apt-get07:20:020
3214379931,1cyclictest0-21swapper/311:35:123
3214379930,3cyclictest375355-21chrt09:25:023
3214379930,3cyclictest0-21swapper/311:40:053
3214379930,3cyclictest0-21swapper/310:35:083
3214379930,3cyclictest0-21swapper/310:15:183
3214379930,3cyclictest0-21swapper/308:50:073
3214379930,2cyclictest0-21swapper/311:50:143
3214379930,2cyclictest0-21swapper/309:30:123
3214379930,1cyclictest0-21swapper/311:25:103
3214379930,0cyclictest0-21swapper/309:40:083
3214379930,0cyclictest0-21swapper/308:40:033
13129830,2rtkit-daemon714-21ntpd12:20:262
13129830,2rtkit-daemon323427-21munin-node12:34:592
13129830,2rtkit-daemon323427-21munin-node10:18:252
13129830,2rtkit-daemon323427-21munin-node08:45:012
13129830,2rtkit-daemon2121-21packagekitd12:35:512
13129830,2rtkit-daemon1234-21cron09:57:002
13129830,2rtkit-daemon1-21systemd09:30:152
13129830,2rtkit-daemon1-21systemd09:10:192
13129830,2rtkit-daemon1-21systemd08:40:172
13129830,1rtkit-daemon717-21lldpd12:15:382
13129830,1rtkit-daemon717-21lldpd11:06:062
13129830,1rtkit-daemon717-21lldpd09:41:042
13129830,1rtkit-daemon717-21lldpd09:26:412
13129830,1rtkit-daemon717-21lldpd08:01:032
13129830,1rtkit-daemon714-21ntpd09:21:552
13129830,1rtkit-daemon617-21gmain07:13:422
13129830,1rtkit-daemon539-21wpa_supplicant10:05:582
13129830,1rtkit-daemon539-21wpa_supplicant08:13:112
13129830,1rtkit-daemon438279-21/usr/sbin/munin11:55:122
13129830,1rtkit-daemon375-21systemd-udevd07:28:292
13129830,1rtkit-daemon356-21systemd-journal10:53:552
13129830,1rtkit-daemon356-21systemd-journal10:25:532
13129830,1rtkit-daemon323427-21munin-node08:17:032
13129830,1rtkit-daemon3191333-21snmpd11:27:562
13129830,1rtkit-daemon3191333-21snmpd10:30:102
13129830,1rtkit-daemon1-21systemd12:00:242
13129830,1rtkit-daemon1-21systemd11:48:312
13129830,1rtkit-daemon1-21systemd11:42:132
13129830,1rtkit-daemon1-21systemd11:31:392
13129830,1rtkit-daemon1-21systemd11:20:362
13129830,1rtkit-daemon1-21systemd11:13:202
13129830,1rtkit-daemon1-21systemd10:47:582
13129830,1rtkit-daemon1-21systemd10:00:462
13129830,1rtkit-daemon1-21systemd08:30:122
13129830,1rtkit-daemon1-21systemd07:38:302
455412220,0sleep00-21swapper/012:34:500
454892220,1sleep10-21swapper/112:30:241
452993220,0sleep00-21swapper/012:29:220
448082220,0sleep00-21swapper/012:15:570
441349220,1sleep0441431-21wc12:00:200
440122220,1sleep0440179-21munin-run12:00:000
431433220,1sleep1431489-21munin-run11:40:011
412500220,0sleep00-21swapper/010:55:020
406434220,1sleep2406438-21ssh10:40:022
397488220,1sleep1397504-21munin-run10:20:001
388667220,1sleep0388938-21df_inode09:55:140
386777220,1sleep1386843-21diskstats09:50:151
381181220,1sleep10-21swapper/109:35:341
377213220,1sleep00-21swapper/009:29:570
376178220,1sleep1376237-21proc_pri09:25:171
374397220,0sleep00-21swapper/009:21:090
372699220,1sleep0372701-21cat09:19:550
371647220,1sleep1371818-21python309:15:201
365786220,1sleep1365891-21/usr/sbin/munin09:00:231
360060220,1sleep0360276-21unixbench-2d08:45:220
350422220,0sleep00-21swapper/008:20:210
347986220,0sleep00-21swapper/008:15:160
346038220,1sleep1346115-21wc08:10:181
340568220,1sleep1340715-21/usr/sbin/munin07:55:211
332933220,1sleep1333065-21cat07:35:241
13129820,1rtkit-daemon617-21gmain09:05:032
13129820,1rtkit-daemon617-21gmain07:55:142
13129820,1rtkit-daemon412749-21/usr/sbin/munin10:55:092
13129820,1rtkit-daemon323427-21munin-node09:35:412
13129820,1rtkit-daemon3191333-21snmpd08:35:342
13129820,1rtkit-daemon269977-21sendmail-mta11:50:432
13129820,1rtkit-daemon1-21systemd10:10:302
13129820,1rtkit-daemon1-21systemd08:55:152
13129820,1rtkit-daemon1-21systemd08:25:202
13129820,1rtkit-daemon1-21systemd07:46:032
13129820,1rtkit-daemon1-21systemd07:41:552
13129820,1rtkit-daemon1-21systemd07:22:532
13129820,0rtkit-daemon1-21systemd12:10:432
13129820,0rtkit-daemon0-21swapper/212:25:162
13129820,0rtkit-daemon0-21swapper/212:05:182
13129820,0rtkit-daemon0-21swapper/208:20:132
13129820,0rtkit-daemon0-21swapper/207:50:012
456302210,0sleep00-21swapper/012:35:190
455686210,0sleep10-21swapper/112:35:121
451221210,0sleep10-21swapper/112:25:111
449244210,0sleep10-21swapper/112:20:201
448578210,0sleep00-21swapper/012:20:030
446824210,0sleep10-21swapper/112:15:151
445144210,0sleep10-21swapper/112:10:181
444341210,0sleep00-21swapper/012:10:010
442598210,0sleep00-21swapper/012:05:180
440520210,0sleep10-21swapper/112:00:141
438301210,0sleep10-21swapper/111:55:131
436365210,0sleep00-21swapper/011:50:170
435918210,0sleep10-21swapper/111:50:021
434231210,0sleep00-21swapper/011:45:160
433555210,0sleep10-21swapper/111:45:021
433101210,1sleep00-21swapper/011:40:590
431844210,0sleep10-21swapper/111:40:121
429567210,0sleep00-21swapper/011:35:040
427916210,0sleep10-21swapper/111:30:171
427654210,0sleep00-21swapper/011:30:150
426132210,0sleep00-21swapper/011:25:190
425472210,0sleep10-21swapper/111:25:111
423832210,0sleep00-21swapper/011:20:190
423514210,0sleep10-21swapper/111:20:161
421153210,0sleep10-21swapper/111:15:121
421151210,0sleep00-21swapper/011:15:100
419561210,0sleep10-21swapper/111:10:151
419053210,0sleep00-21swapper/011:10:110
418331210,0sleep00-21swapper/011:05:540
417562210,0sleep10-21swapper/111:05:151
414897210,0sleep10-21swapper/111:00:151
414644210,0sleep00-21swapper/011:00:010
412742210,0sleep10-21swapper/110:55:061
411991210,0sleep10-21swapper/110:50:351
410654210,0sleep00-21swapper/010:50:140
409228210,0sleep00-21swapper/010:45:160
408556210,0sleep10-21swapper/110:45:091
407204210,0sleep00-21swapper/010:40:210
405969210,0sleep10-21swapper/110:40:011
404884210,1sleep00-21swapper/010:35:210
403819210,0sleep10-21swapper/110:35:021
402953210,0sleep10-21swapper/110:30:211
402782210,0sleep00-21swapper/010:30:190
399863210,0sleep00-21swapper/010:25:120
399613210,0sleep10-21swapper/110:25:001
398014210,0sleep00-21swapper/010:20:120
396940210,0sleep00-21swapper/010:15:150
396143210,0sleep10-21swapper/110:10:231
394938210,0sleep00-21swapper/010:10:150
392731210,0sleep00-21swapper/010:05:110
392716210,0sleep10-21swapper/110:05:041
391508210,0sleep00-21swapper/010:00:220
390632210,0sleep10-21swapper/110:00:111
389326210,0sleep10-21swapper/109:55:181
386565210,0sleep00-21swapper/009:50:140
384790210,0sleep00-21swapper/009:45:170
382059210,0sleep00-21swapper/009:40:140
381936210,0sleep10-21swapper/109:40:021
379589210,0sleep00-21swapper/009:35:010
377843210,0sleep10-21swapper/109:30:131
377222210,0sleep00-21swapper/009:30:000
373497210,0sleep10-21swapper/109:20:181
368748210,0sleep10-21swapper/109:10:131
368719210,0sleep00-21swapper/009:10:120
367575210,0sleep00-21swapper/009:05:200
366878210,0sleep10-21swapper/109:05:131
364928210,0sleep00-21swapper/009:00:140
364239210,1sleep00-21swapper/008:55:270
363352210,0sleep10-21swapper/108:55:161
361508210,0sleep00-21swapper/008:50:190
361152210,0sleep10-21swapper/108:50:161
359229210,0sleep10-21swapper/108:45:151
358751210,0sleep00-21swapper/008:44:070
357148210,0sleep10-21swapper/108:40:111
355678210,0sleep10-21swapper/108:35:151
354959210,0sleep00-21swapper/008:35:020
353555210,0sleep10-21swapper/108:30:221
353373210,0sleep00-21swapper/008:30:130
351109210,0sleep00-21swapper/008:25:020
349224210,0sleep10-21swapper/108:20:021
347573210,0sleep10-21swapper/108:15:131
347175210,0sleep00-21swapper/008:14:170
343695210,0sleep00-21swapper/008:05:120
341820210,0sleep10-21swapper/108:00:161
341776210,0sleep00-21swapper/008:00:150
340444210,0sleep00-21swapper/007:55:200
338080210,0sleep10-21swapper/107:50:171
337969210,0sleep00-21swapper/007:50:160
336041210,0sleep10-21swapper/107:45:111
334624210,0sleep10-21swapper/107:40:161
334049210,0sleep00-21swapper/007:40:110
332039210,0sleep00-21swapper/007:35:150
331403210,1sleep00-21swapper/007:31:140
330853210,0sleep10-21swapper/107:30:191
328554210,0sleep00-21swapper/007:25:140
328153210,0sleep10-21swapper/107:25:111
326296210,0sleep10-21swapper/107:20:151
324822210,0sleep00-21swapper/007:15:210
323994210,0sleep10-21swapper/107:15:141
321608210,0sleep10-21swapper/107:10:111
321579210,0sleep00-21swapper/007:10:100
335909200,0sleep00-21swapper/007:45:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional