You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-31 - 01:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #2

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-2310E @2100 MHz, Linux 5.10.47-rt46 (Profile)

Latency plot of shadow in rack #8, slot #2
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by a total of 2 SMIs that occured during the measurement.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 --smi -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack8slot2s.osadl.org (updated Mon Jan 30, 2023 12:43:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2717899112110,1cyclictest0-21swapper/207:11:352
2717899110107,2cyclictest11436-21apt-get07:46:362
270921030,0sleep30-21swapper/309:52:593
165372940,2sleep316539-21gltestperf11:56:523
2482129345,39sleep00-21swapper/007:06:360
2656529246,34sleep10-21swapper/107:07:091
2689529040,38sleep30-21swapper/307:11:293
2663129047,31sleep20-21swapper/207:08:022
27179998987,1cyclictest0-21swapper/307:11:353
11442870,0sleep00-21swapper/010:20:340
27179998583,1cyclictest0-21swapper/307:46:363
145942850,0sleep20-21swapper/209:01:522
240432840,0sleep00-21swapper/011:35:530
286272750,1sleep00-21swapper/009:47:030
27176997169,1cyclictest0-21swapper/007:11:350
27176996966,2cyclictest0-21swapper/007:46:360
27177995326,26cyclictest0-21swapper/111:21:361
27177994335,7cyclictest0-21swapper/107:11:351
27177994131,9cyclictest0-21swapper/107:46:361
220932280,1sleep20-21swapper/211:33:232
2717999260,24cyclictest6623-21kworker/u8:111:21:513
131432260,0sleep30-21swapper/312:21:533
27179992516,6cyclictest20747-21ssh11:05:083
27179992220,1cyclictest0-21swapper/309:06:523
2717899221,20cyclictest0-21swapper/208:11:532
2717899221,1cyclictest0-21swapper/210:51:512
2717699220,1cyclictest0-21swapper/010:51:510
119942210,1sleep228-21ksoftirqd/209:32:382
2717799198,8cyclictest28123-21diskmemload12:34:221
27177991813,4cyclictest8413-21ssh09:57:541
2717999172,12cyclictest20444-21ntpq11:32:003
27178991715,1cyclictest3959-21ssh09:26:512
2717999164,7cyclictest0-21swapper/309:16:583
2717799162,11cyclictest31392-21sh10:17:421
2717799161,1cyclictest0-21swapper/111:16:521
2717699166,8cyclictest28640-21idleruntime-cro10:16:340
175982160,0sleep10-21swapper/111:01:591
91212150,4sleep012-21ksoftirqd/012:17:410
2717899157,3cyclictest0-21swapper/211:30:392
2717799158,6cyclictest0-21swapper/107:17:561
2717799156,3cyclictest0-21swapper/112:09:161
2717999147,2cyclictest442-21dump-pmu-power12:11:353
2717899142,7cyclictest0-21swapper/208:31:542
2717799149,3cyclictest14269-21cpuspeed_turbos10:31:541
2717799147,6cyclictest0-21swapper/108:03:361
2717799146,4cyclictest0-21swapper/112:15:201
2717799144,6cyclictest13064-21ssh11:53:281
2717799144,5cyclictest0-21swapper/110:01:451
2717799142,8cyclictest24670-21ssh09:43:581
2717799142,3cyclictest9122-21ssh11:50:501
2717799141,6cyclictest10016-21ssh12:18:501
2717799140,7cyclictest4995-21acpi08:41:541
90762130,1sleep20-21swapper/210:26:582
90762130,1sleep20-21swapper/210:26:582
2717999138,3cyclictest16518-21cat09:36:583
2717999135,6cyclictest0-21swapper/309:41:393
2717999134,4cyclictest0-21swapper/309:31:553
2717999133,8cyclictest27765-21cron08:21:343
2717999133,5cyclictest0-21swapper/311:49:343
2717999131,5cyclictest6869-21cut12:16:543
2717999131,5cyclictest25694-21gltestperf11:36:583
2717899137,4cyclictest19921-21cut09:11:582
2717899135,4cyclictest1459-21ssh10:20:582
2717899133,5cyclictest0-21swapper/211:21:562
2717799139,2cyclictest18354-21head09:07:051
2717799138,4cyclictest0-21swapper/111:39:181
2717799137,4cyclictest31444-21ntp_states08:26:581
2717799136,6cyclictest0-21swapper/108:52:381
2717799136,6cyclictest0-21swapper/107:32:401
2717799136,6cyclictest0-21swapper/107:27:061
2717799136,6cyclictest0-21swapper/107:22:181
2717799136,4cyclictest6562-21sh09:28:061
2717799135,7cyclictest0-21swapper/108:00:361
2717799135,5cyclictest0-21swapper/110:43:321
2717799133,3cyclictest9119-21cat10:26:581
2717799133,3cyclictest9119-21cat10:26:581
2717799132,6cyclictest0-21swapper/111:13:461
2717799131,8cyclictest0-21swapper/109:38:301
2717799131,1cyclictest0-21swapper/110:54:141
2717699133,5cyclictest0-21swapper/009:12:000
256602130,5sleep012-21ksoftirqd/011:36:570
2717999127,3cyclictest25162-21unixbench_singl10:12:093
2717999126,4cyclictest21160-21wc10:37:013
2717999125,6cyclictest0-21swapper/308:50:073
2717999125,6cyclictest0-21swapper/308:50:073
2717999125,6cyclictest0-21swapper/307:23:503
2717999125,5cyclictest232-21systemd-journal11:15:113
2717999124,6cyclictest972-21mii-tool08:31:543
2717999124,4cyclictest7241-21ssh09:28:593
2717999122,4cyclictest34-21ksoftirqd/308:41:343
2717999121,9cyclictest17032-21gltestperf07:56:563
2717999121,5cyclictest10310-21ssh10:56:353
2717999120,7cyclictest12169-21ssh10:29:493
2717999120,7cyclictest12169-21ssh10:29:493
2717899127,3cyclictest28277-21grep08:21:522
2717899126,4cyclictest7552-21tr08:46:512
2717899126,4cyclictest7552-21tr08:46:512
2717899125,6cyclictest0-21swapper/208:04:032
2717899125,5cyclictest527-21dbus-daemon11:21:342
2717899124,7cyclictest0-21swapper/211:58:432
2717899124,6cyclictest0-21swapper/211:42:192
2717899124,3cyclictest0-21swapper/211:47:192
2717899123,8cyclictest0-21swapper/212:36:552
2717899123,6cyclictest28150-21ssh10:15:582
2717899121,9cyclictest0-21swapper/209:56:412
2717799125,6cyclictest0-21swapper/112:21:481
2717799125,6cyclictest0-21swapper/109:16:381
2717799125,6cyclictest0-21swapper/109:06:181
2717799125,6cyclictest0-21swapper/108:49:261
2717799125,6cyclictest0-21swapper/108:49:261
2717799125,6cyclictest0-21swapper/108:16:381
2717799125,6cyclictest0-21swapper/108:11:481
2717799125,6cyclictest0-21swapper/108:07:481
2717799125,6cyclictest0-21swapper/107:42:421
2717799125,5cyclictest575-21snmpd08:23:041
2717799125,5cyclictest527-21dbus-daemon08:37:021
2717799124,7cyclictest0-21swapper/112:26:401
2717799124,7cyclictest0-21swapper/111:42:001
2717799124,6cyclictest32682-21ssh12:37:451
2717799124,2cyclictest31971-21df10:46:541
2717799123,7cyclictest1520-21ssh09:23:561
2717799121,9cyclictest3900-21ssh09:54:331
2717799120,2cyclictest13533-21ssh11:26:511
2717699127,4cyclictest30798-21head07:16:580
2717699125,5cyclictest15230-21unixbench-2d11:27:040
2717699124,5cyclictest0-21swapper/011:12:120
2717699123,8cyclictest0-21swapper/007:52:260
2717699123,8cyclictest0-21swapper/007:42:560
2717699122,5cyclictest0-21swapper/007:32:140
2717699121,10cyclictest0-21swapper/012:24:180
2717999117,2cyclictest570-21runrttasks09:51:173
2717999117,2cyclictest31436-21fschecks_count11:42:023
2717999116,3cyclictest31500-21pmu-power08:26:593
2717999116,3cyclictest11547-21cat07:46:343
2717999115,4cyclictest5199-21grep08:41:563
2717999115,4cyclictest25818-21cut10:41:563
2717999115,4cyclictest232-21systemd-journal07:40:553
2717999115,2cyclictest141rcu_preempt10:21:293
2717999114,5cyclictest1715-21cut11:16:523
2717999114,5cyclictest0-21swapper/310:01:153
2717999113,6cyclictest26506-21apt-get11:10:063
2717999113,6cyclictest21671-21tail08:06:543
2717999113,4cyclictest575-21snmpd09:23:563
2717999113,3cyclictest0-21swapper/307:30:293
2717999112,8cyclictest0-21swapper/308:04:393
2717999112,4cyclictest24426-21apt-get12:31:503
2717999111,5cyclictest0-21swapper/309:01:563
2717999111,4cyclictest20150-21switchtime12:27:083
2717999111,4cyclictest17085-21latency_hist10:06:343
2717999110,9cyclictest10812-21aten2_r8power_c10:56:523
2717999110,5cyclictest28788-21if_enp4s008:21:553
2717899119,1cyclictest0-21swapper/211:12:012
2717899118,2cyclictest0-21swapper/210:39:212
2717899116,3cyclictest26284-21tail08:16:582
2717899116,3cyclictest0-21swapper/208:58:582
2717899115,4cyclictest527-21dbus-daemon08:42:062
2717899115,4cyclictest26197-21cut09:17:022
2717899115,4cyclictest24581-21cron11:41:292
2717899115,4cyclictest22325-21head12:01:542
2717899115,4cyclictest22325-21head12:01:542
2717899115,4cyclictest22134-21cut08:06:592
2717899115,4cyclictest18751-21aten2_r8power_e12:26:582
2717899115,4cyclictest17968-21sendmail_mailqu09:07:032
2717899114,6cyclictest0-21swapper/212:34:172
2717899114,6cyclictest0-21swapper/210:09:522
2717899114,5cyclictest17218-21awk07:56:582
2717899113,3cyclictest0-21swapper/207:19:042
2717899111,8cyclictest6806-21munin-run07:36:352
2717899111,5cyclictest570-21runrttasks09:22:082
2717899111,5cyclictest0-21swapper/212:12:412
2717899111,5cyclictest0-21swapper/210:21:572
2717899110,5cyclictest572-21cron08:56:342
2717799115,4cyclictest14262-21tr07:51:511
2717799115,4cyclictest0-21swapper/110:07:041
2717799114,6cyclictest0-21swapper/110:36:501
2717799114,6cyclictest0-21swapper/108:32:521
2717799114,6cyclictest0-21swapper/107:37:181
2717799114,5cyclictest0-21swapper/109:15:381
2717799114,2cyclictest27410-21ssh10:15:001
2717799114,1cyclictest0-21swapper/110:21:581
2717799114,1cyclictest0-21swapper/108:57:121
2717799113,6cyclictest23455-21cut11:07:001
2717799111,7cyclictest13493-21ssh10:58:121
2717799111,4cyclictest28945-21unixbench_singl09:47:051
2717799110,8cyclictest0-21swapper/111:59:421
2717699118,2cyclictest32641-21grep11:42:120
2717699117,3cyclictest23989-21cron12:31:350
2717699117,3cyclictest0-21swapper/011:22:390
2717699117,2cyclictest12084-21aten2_r8power_c08:56:520
2717699116,3cyclictest10923-21sh10:01:080
2717699115,5cyclictest0-21swapper/011:52:190
2717699115,4cyclictest597-21gdbus08:42:060
2717699115,4cyclictest4419-21entropy09:26:540
2717699115,4cyclictest4120-21gdbus11:46:350
2717699115,4cyclictest2717-21cat10:21:530
2717699115,4cyclictest21879-21perf11:06:340
2717699115,4cyclictest16481-21tr07:56:530
2717699115,4cyclictest11256-21entropy10:56:550
2717699115,4cyclictest0-21swapper/008:11:090
2717699114,5cyclictest5901-21chrt11:20:060
2717699114,5cyclictest0-21swapper/012:13:380
2717699114,5cyclictest0-21swapper/008:39:520
2717699114,5cyclictest0-21swapper/008:32:340
2717699111,3cyclictest30257-21munin-run09:21:350
213202110,1sleep00-21swapper/009:41:500
2717999107,2cyclictest43450irq/33-enp3s0-r12:36:503
2717999106,3cyclictest43450irq/33-enp3s0-r10:21:563
2717999105,4cyclictest1484-21fschecks_count12:12:003
2717999105,4cyclictest13664-21grep11:26:523
2717999105,3cyclictest19464-21cpuspeed_turbos09:11:553
2717999105,3cyclictest11352-21sh11:52:003
2717999104,5cyclictest575-21snmpd10:46:443
2717999104,4cyclictest527-21dbus-daemon12:02:013
2717999104,4cyclictest527-21dbus-daemon12:02:013
2717999104,4cyclictest17508-21acpi10:06:513
2717999104,4cyclictest12668-21head08:56:553
2717999103,5cyclictest575-21snmpd07:31:593
2717999102,6cyclictest575-21snmpd08:51:523
2717999101,7cyclictest0-21swapper/308:11:543
2717999100,8cyclictest15749-21/usr/sbin/munin10:32:053
2717899107,2cyclictest14450irq/32-ahci[00007:51:522
2717899106,3cyclictest31180-21if_err_enp5s008:26:552
2717899106,2cyclictest22657-21ls09:42:052
2717899106,2cyclictest14258-21cpuspeed_turbos10:31:542
2717899105,3cyclictest28828-21processes12:07:022
2717899105,3cyclictest17085-21latency_hist10:06:342
2717899104,4cyclictest6861-21cut12:16:542
2717899104,4cyclictest28367-21ntpq09:47:012
2717899104,4cyclictest2701-21grep07:26:512
2717899104,3cyclictest0-21swapper/210:41:502
2717899103,5cyclictest575-21snmpd09:37:002
2717899103,5cyclictest575-21snmpd08:39:552
2717899103,5cyclictest17206-21tail11:01:562
2717899103,5cyclictest14004-21ssh11:54:402
2717899102,4cyclictest25400-21ssh11:08:422
2717899101,6cyclictest11663-21ssh10:56:572
2717899101,4cyclictest0-21swapper/207:24:592
2717799103,6cyclictest1834-1kworker/u9:109:31:591
2717799102,3cyclictest0-21swapper/111:31:571
2717799101,4cyclictest22810-21missed_timers12:01:581
2717799101,4cyclictest22810-21missed_timers12:01:581
2717699106,3cyclictest12-21ksoftirqd/009:06:580
2717699106,2cyclictest18769-21diskmemload09:21:430
2717699105,4cyclictest28182-21expr12:06:560
2717699105,4cyclictest232-21systemd-journal09:33:040
2717699105,4cyclictest22149-21df12:01:520
2717699105,4cyclictest22149-21df12:01:520
2717699105,4cyclictest18457-21irqstats10:06:590
2717699105,4cyclictest0-21swapper/010:37:080
2717699105,3cyclictest30588-21grep12:36:520
2717699104,5cyclictest0-21swapper/012:36:270
2717699104,5cyclictest0-21swapper/008:47:260
2717699104,5cyclictest0-21swapper/008:47:260
2717699104,5cyclictest0-21swapper/008:26:570
2717699104,4cyclictest25799-21tr08:16:530
2717699104,4cyclictest0-21swapper/009:54:180
2717699104,4cyclictest0-21swapper/008:12:120
2717699103,5cyclictest0-21swapper/010:27:490
2717699103,5cyclictest0-21swapper/010:27:490
2717699103,5cyclictest0-21swapper/007:24:080
2717699103,4cyclictest0-21swapper/011:07:290
2717699103,4cyclictest0-21swapper/009:36:570
2717699102,3cyclictest0-21swapper/008:01:550
2717699101,4cyclictest20640-21ssh12:00:460
2717699101,1cyclictest0-21swapper/007:36:540
2717699100,9cyclictest1092-21ssh10:47:180
2717699100,9cyclictest0-21swapper/010:41:560
271799994,3cyclictest29501-21munin-node07:16:353
271799994,3cyclictest0-21swapper/307:51:353
271789996,2cyclictest18769-21diskmemload12:21:382
271789994,3cyclictest32524-21ssh09:51:482
271789993,5cyclictest575-21snmpd07:42:472
271789993,4cyclictest575-21snmpd10:46:532
271789993,4cyclictest575-21snmpd07:36:442
271769994,4cyclictest28563-21fschecks_time08:21:540
271769994,4cyclictest15690-21cut09:02:010
271769994,4cyclictest0-21swapper/010:31:520
271769994,4cyclictest0-21swapper/008:51:430
271769993,5cyclictest0-21swapper/007:26:500
271769992,3cyclictest12-21ksoftirqd/010:04:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional