You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-19 - 01:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Thu Apr 18, 2024 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2492699270,26cyclictest0-21swapper/012:19:250
2493199260,25cyclictest0-21swapper/109:12:521
24935992523,1cyclictest0-21swapper/209:10:002
2493199250,24cyclictest19153-21diskmemload09:48:361
2493199250,24cyclictest0-21swapper/109:18:001
24926992523,2cyclictest27891-21diskmemload10:22:020
24926992523,1cyclictest0-21swapper/009:41:530
2492699250,24cyclictest19153-21diskmemload11:42:450
2494099240,23cyclictest615-21polkitd09:05:003
2494099240,23cyclictest19301-21ssh09:41:043
2494099240,23cyclictest0-21swapper/311:11:553
2493599240,23cyclictest19153-21diskmemload09:21:012
2493599240,0cyclictest0-21swapper/212:22:292
24931992423,1cyclictest19153-21diskmemload11:33:021
24931992422,1cyclictest17514-21apt-get10:46:561
2493199240,24cyclictest0-21swapper/111:20:041
2493199240,24cyclictest0-21swapper/110:01:361
2493199240,23cyclictest19153-21diskmemload10:10:521
2493199240,23cyclictest0-21swapper/112:24:311
2493199240,23cyclictest0-21swapper/111:43:531
2493199240,1cyclictest19153-21diskmemload09:41:361
2493199240,0cyclictest0-21swapper/112:35:551
2493199240,0cyclictest0-21swapper/109:37:311
24926992422,1cyclictest24733-21ssh09:15:120
2492699240,3cyclictest14280-21dump-pmu-power07:55:000
2492699240,23cyclictest3315-21ssh09:25:570
2492699240,23cyclictest2655-21ssh09:56:130
2492699240,23cyclictest19153-21diskmemload11:15:440
2492699240,23cyclictest14367-21plymouth08:59:590
2492699240,1cyclictest19153-21diskmemload11:28:580
2492699240,0cyclictest19153-21diskmemload11:33:570
2492699240,0cyclictest19153-21diskmemload10:33:580
24940992323,0cyclictest19153-21diskmemload12:36:073
24940992323,0cyclictest19153-21diskmemload09:53:043
24940992323,0cyclictest19153-21diskmemload09:22:123
24940992323,0cyclictest0-21swapper/312:19:253
24940992323,0cyclictest0-21swapper/311:42:453
24940992323,0cyclictest0-21swapper/310:53:263
24940992323,0cyclictest0-21swapper/309:56:123
2494099230,23cyclictest19153-21diskmemload11:15:363
2494099230,23cyclictest0-21swapper/312:30:433
2494099230,23cyclictest0-21swapper/311:53:163
2494099230,23cyclictest0-21swapper/311:27:583
2494099230,23cyclictest0-21swapper/310:38:033
2494099230,23cyclictest0-21swapper/310:33:053
2494099230,23cyclictest0-21swapper/309:45:393
2494099230,23cyclictest0-21swapper/309:27:213
2494099230,22cyclictest29823-21ssh10:24:503
2494099230,22cyclictest23183-21sh12:01:503
2494099230,22cyclictest2174-21munin-run07:30:013
2494099230,22cyclictest19153-21diskmemload10:12:023
2494099230,22cyclictest18640-21systemd-journal07:15:003
2494099230,22cyclictest11313-21sh09:32:403
2494099230,0cyclictest19153-21diskmemload10:17:143
2494099230,0cyclictest0-21swapper/312:12:223
2494099230,0cyclictest0-21swapper/309:16:563
24935992323,0cyclictest19153-21diskmemload12:00:292
24935992323,0cyclictest0-21swapper/211:09:092
24935992323,0cyclictest0-21swapper/210:27:412
24935992323,0cyclictest0-21swapper/210:24:042
24935992321,1cyclictest3619-21dpkg12:15:002
24935992321,1cyclictest0-21swapper/212:31:582
24935992321,1cyclictest0-21swapper/209:14:222
24935992320,2cyclictest8655-21ssh09:31:122
2493599230,23cyclictest19153-21diskmemload12:37:072
2493599230,23cyclictest19153-21diskmemload09:38:552
2493599230,23cyclictest0-21swapper/212:27:012
2493599230,23cyclictest0-21swapper/209:28:582
2493599230,22cyclictest29585-21dpkg08:25:002
2493599230,22cyclictest22291-21apt-get08:11:522
2493599230,22cyclictest16155-21sh11:52:542
2493599230,22cyclictest0-21swapper/210:41:552
2493599230,22cyclictest0-21swapper/209:54:112
2493599230,0cyclictest0-21swapper/211:43:292
2493599230,0cyclictest0-21swapper/211:21:162
2493599230,0cyclictest0-21swapper/210:37:072
2493599230,0cyclictest0-21swapper/209:45:172
24931992323,0cyclictest0-21swapper/112:09:181
24931992323,0cyclictest0-21swapper/112:00:211
24931992323,0cyclictest0-21swapper/111:06:371
24931992323,0cyclictest0-21swapper/110:54:021
24931992323,0cyclictest0-21swapper/110:41:211
24931992323,0cyclictest0-21swapper/110:33:031
24931992323,0cyclictest0-21swapper/109:30:181
24931992322,1cyclictest19153-21diskmemload10:24:091
24931992321,1cyclictest0-21swapper/110:58:551
2493199230,22cyclictest3890-21ssh09:26:511
2493199230,22cyclictest0-21swapper/110:36:421
2493199230,22cyclictest0-21swapper/109:55:021
2493199230,1cyclictest0-21swapper/108:20:001
2493199230,0cyclictest19153-21diskmemload11:56:201
24926992323,0cyclictest19153-21diskmemload12:38:560
24926992323,0cyclictest0-21swapper/012:06:070
24926992323,0cyclictest0-21swapper/011:55:310
24926992323,0cyclictest0-21swapper/010:48:470
24926992323,0cyclictest0-21swapper/009:21:320
24926992322,1cyclictest0-21swapper/010:19:320
24926992321,1cyclictest31774-21/usr/sbin/munin09:52:030
24926992321,1cyclictest26196-21sh10:55:500
24926992320,2cyclictest13633-21sh12:25:090
2492699230,2cyclictest21724-21sh10:51:110
2492699230,23cyclictest19153-21diskmemload10:40:420
2492699230,22cyclictest2754-21sshd08:36:530
2492699230,22cyclictest19153-21diskmemload09:10:220
2492699230,22cyclictest0-21swapper/011:46:440
2492699230,22cyclictest0-21swapper/011:46:440
2492699230,22cyclictest0-21swapper/011:25:000
2492699230,0cyclictest19153-21diskmemload12:10:120
2492699230,0cyclictest0-21swapper/012:20:060
2492699230,0cyclictest0-21swapper/010:36:560
2492699230,0cyclictest0-21swapper/010:07:150
24940992222,0cyclictest0-21swapper/312:20:063
24940992222,0cyclictest0-21swapper/310:45:123
24940992222,0cyclictest0-21swapper/310:40:413
24940992222,0cyclictest0-21swapper/310:07:153
24940992220,1cyclictest7181-21munin-run08:45:003
24940992220,1cyclictest0-21swapper/308:00:003
2494099221,1cyclictest27058-21diskmemload12:05:153
2494099220,22cyclictest19153-21diskmemload11:21:373
2494099220,22cyclictest13729-21ssh09:36:063
2494099220,21cyclictest31095-21sh11:35:283
2494099220,21cyclictest11960-21dump-pmu-power08:55:003
2494099220,21cyclictest11235-21perf10:05:003
2494099220,1cyclictest7867-21snmpd12:25:473
2494099220,1cyclictest26822-21avahi-daemon07:55:003
2494099220,0cyclictest0-21swapper/311:03:103
2494099220,0cyclictest0-21swapper/310:57:533
24935992222,0cyclictest0-21swapper/211:59:412
24935992222,0cyclictest0-21swapper/211:46:452
24935992222,0cyclictest0-21swapper/211:46:452
24935992221,1cyclictest28771-21ssh11:32:072
24935992220,2cyclictest0-21swapper/210:11:402
24935992220,1cyclictest19091-21dump-pmu-power08:05:002
24935992220,1cyclictest16667-21rm10:45:252
24935992220,1cyclictest0-21swapper/210:50:202
24935992220,1cyclictest0-21swapper/209:40:482
24935992219,2cyclictest7153-21idleruntime-cro08:45:002
24935992219,2cyclictest1904-21sh09:55:032
2493599220,22cyclictest0-21swapper/210:55:592
2493599220,21cyclictest75-21kswapd012:15:012
2493599220,21cyclictest7081-21perf07:40:002
2493599220,21cyclictest4773-21munin-plugin-st08:40:002
2493599220,21cyclictest29798-21basename07:20:012
2493599220,21cyclictest16782-21latency_hist09:05:002
2493599220,21cyclictest12484-21apt-get10:06:542
2493599220,21cyclictest0-21swapper/210:16:192
2493599220,21cyclictest0-21swapper/208:30:002
2493599220,1cyclictest0-21swapper/211:20:002
24931992222,0cyclictest19153-21diskmemload11:11:431
24931992222,0cyclictest0-21swapper/112:11:071
24931992222,0cyclictest0-21swapper/111:15:211
24931992220,1cyclictest0-21swapper/107:35:001
2493199220,22cyclictest0-21swapper/110:25:061
2493199220,21cyclictest3605-21apt-get12:15:011
2493199220,21cyclictest18640-21systemd-journal11:30:001
2493199220,21cyclictest14394-21sendmail-msp08:59:591
2493199220,21cyclictest0-21swapper/111:46:081
2493199220,21cyclictest0-21swapper/111:46:071
2493199220,21cyclictest0-21swapper/111:35:271
2493199220,21cyclictest0-21swapper/111:02:031
2493199220,21cyclictest0-21swapper/110:08:081
2493199220,21cyclictest0-21swapper/109:20:451
2493199220,1cyclictest19153-21diskmemload10:15:501
2493199220,0cyclictest0-21swapper/112:30:301
24926992222,0cyclictest19153-21diskmemload11:06:000
24926992222,0cyclictest19153-21diskmemload11:03:000
24926992222,0cyclictest0-21swapper/012:30:330
24926992222,0cyclictest0-21swapper/010:01:080
24926992221,1cyclictest16097-21rm11:52:480
24926992220,2cyclictest24811-21sh09:46:360
2492699221,21cyclictest0-21swapper/010:10:430
2492699221,0cyclictest62150irq/126-eno111:11:350
2492699220,21cyclictest0-21swapper/012:02:360
2492699220,21cyclictest0-21swapper/009:30:230
2492699220,21cyclictest0-21swapper/008:45:000
2492699220,1cyclictest31372-21rm11:36:000
2492699220,1cyclictest27372-21grep07:15:000
2492699220,1cyclictest16706-21perf08:00:000
24940992120,1cyclictest14363-21latency_hist08:59:593
24940992119,1cyclictest597-21dbus-daemon08:05:003
2494099210,21cyclictest6105-1kworker/u9:211:58:373
2494099210,21cyclictest0-21swapper/311:48:283
2494099210,21cyclictest0-21swapper/311:48:283
2494099210,21cyclictest0-21swapper/311:05:263
2494099210,21cyclictest0-21swapper/310:27:153
2494099210,21cyclictest0-21swapper/309:10:033
2494099210,20cyclictest0-21swapper/307:41:523
24935992121,0cyclictest19153-21diskmemload12:07:192
24935992120,0cyclictest25093-21apt-get08:16:532
24935992120,0cyclictest19898-21apt-get08:06:532
24935992120,0cyclictest0-21swapper/207:21:532
2493599210,1cyclictest0-21swapper/210:30:142
2493599210,0cyclictest0-21swapper/211:36:522
2493599210,0cyclictest0-21swapper/211:28:492
2493599210,0cyclictest0-21swapper/211:00:352
2493599210,0cyclictest0-21swapper/210:00:362
2493599210,0cyclictest0-21swapper/208:46:542
24931992121,0cyclictest0-21swapper/112:25:131
24931992120,0cyclictest0-21swapper/108:06:521
24931992119,1cyclictest16785-21perf09:05:001
2493199210,20cyclictest0-21swapper/107:56:541
2493199210,0cyclictest7571-21apt-get08:46:541
2493199210,0cyclictest12285-21apt-get07:51:531
2493199210,0cyclictest0-21swapper/107:11:561
24926992120,0cyclictest0-21swapper/008:01:540
2492699210,20cyclictest7492-21apt-get07:41:520
2492699210,20cyclictest0-21swapper/008:06:530
2492699210,0cyclictest0-21swapper/010:26:070
24940992020,0cyclictest2751-21apt-get08:36:533
24940992020,0cyclictest0-21swapper/308:06:533
24935992020,0cyclictest0-21swapper/208:51:542
24935992020,0cyclictest0-21swapper/207:51:532
24935992020,0cyclictest0-21swapper/207:31:532
24935992020,0cyclictest0-21swapper/207:26:522
24935992018,1cyclictest16680-21idleruntime-cro08:00:012
24931992020,0cyclictest0-21swapper/111:50:031
24931992020,0cyclictest0-21swapper/108:36:531
24931992020,0cyclictest0-21swapper/107:46:551
24931992020,0cyclictest0-21swapper/107:41:521
24931992019,1cyclictest4969-21apt-get07:36:541
24931992019,1cyclictest29766-21perf07:20:001
24931992019,0cyclictest0-21swapper/108:31:531
2493199200,0cyclictest0-21swapper/108:51:541
2493199200,0cyclictest0-21swapper/108:26:531
24926992019,0cyclictest32585-21apt-get07:26:530
24926992017,2cyclictest11971-21awk08:55:000
24940991919,0cyclictest9893-21apt-get07:46:553
24935991917,1cyclictest27356-21cron07:15:002
24931991918,1cyclictest0-21swapper/109:06:541
24931991917,1cyclictest19079-21idleruntime-cro08:05:001
24926991919,0cyclictest0-21swapper/008:15:020
24926991919,0cyclictest0-21swapper/008:11:520
24940991818,0cyclictest0-21swapper/308:46:553
24931991817,1cyclictest5171-21apt-get08:41:531
24931991817,0cyclictest0-21swapper/108:21:571
24926991818,0cyclictest0-21swapper/007:46:550
24926991817,1cyclictest0-21swapper/007:20:000
24926991817,0cyclictest30192-21apt-get08:25:010
24940991715,1cyclictest29785-21munin-run07:20:003
24926991716,0cyclictest0-21swapper/007:21:530
24940991616,0cyclictest0-21swapper/308:15:013
24940991616,0cyclictest0-21swapper/308:11:523
2494099160,14cyclictest0-21swapper/309:05:223
24935991615,0cyclictest0-21swapper/207:41:522
2493199160,15cyclictest0-21swapper/108:11:521
2492699160,1cyclictest18640-21systemd-journal07:36:440
24940991515,0cyclictest0-21swapper/308:25:013
24940991513,1cyclictest32193-21munin-run07:25:003
2493599150,1cyclictest0-21swapper/207:46:592
24940991414,0cyclictest0-21swapper/308:31:413
24940991414,0cyclictest0-21swapper/307:35:353
2494099140,14cyclictest0-21swapper/308:20:453
2494099140,14cyclictest0-21swapper/307:30:263
24935991414,0cyclictest0-21swapper/208:55:042
2493599140,14cyclictest0-21swapper/208:30:202
24931991414,0cyclictest0-21swapper/107:25:081
2493199140,14cyclictest0-21swapper/107:21:211
24926991414,0cyclictest0-21swapper/009:05:170
24926991414,0cyclictest0-21swapper/007:30:200
2492699140,14cyclictest0-21swapper/008:46:230
2492699140,14cyclictest0-21swapper/008:30:410
2492699140,0cyclictest0-21swapper/009:00:340
2492699140,0cyclictest0-21swapper/008:21:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional