You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 02:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

x86 Intel Core i7-E610 @2530 MHz, Linux 5.4.17-rt9 (Profile)

Latency plot of shadow in rack #5, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Fri Aug 12, 2022 12:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2580499174173,1cyclictest0-21swapper/207:10:012
2579599167158,8cyclictest0-21swapper/007:10:010
25513215589,62sleep30-21swapper/307:08:353
2571121360,25sleep121-21ksoftirqd/107:10:001
25278212265,54sleep00-21swapper/007:05:310
255672121108,10sleep20-21swapper/207:09:182
2580399118112,3cyclictest0-21swapper/107:14:251
219562850,0sleep00-21swapper/007:30:260
286482840,0sleep10-21swapper/110:15:221
231962820,1sleep091ksoftirqd/011:37:310
260712810,1sleep30-21swapper/309:05:163
272572790,0sleep10-21swapper/108:05:201
272572790,0sleep10-21swapper/108:05:201
37352780,1sleep30-21swapper/307:45:193
129752760,0sleep00-21swapper/011:49:530
100422710,0sleep00-21swapper/009:49:440
127072700,0sleep20-21swapper/211:31:282
161972680,0sleep30-21swapper/311:16:263
272502330,0sleep20-21swapper/209:57:432
2580399333,25cyclictest0-21swapper/110:08:101
96242280,1sleep30-21swapper/309:15:333
5812250,0sleep09-21ksoftirqd/010:00:260
2580399230,21cyclictest354-21systemd-journal11:44:591
2579599230,21cyclictest354-21systemd-journal10:45:000
131242230,2sleep3113-21kworker/3:111:49:593
2580499220,20cyclictest354-21systemd-journal11:39:592
2579599220,11cyclictest9473-21ssh09:15:320
2580399210,19cyclictest569-21systemd-logind11:15:261
2580399210,19cyclictest354-21systemd-journal11:10:011
2580399210,19cyclictest0-21swapper/109:50:251
2580399200,18cyclictest354-21systemd-journal09:20:001
2579599202,16cyclictest54450irq/29-enp2s0-r12:15:120
2579599200,18cyclictest569-21systemd-logind07:45:240
2579599200,18cyclictest354-21systemd-journal08:00:000
2580499190,17cyclictest354-21systemd-journal12:10:002
2580499190,17cyclictest354-21systemd-journal07:30:222
2580399190,18cyclictest0-21swapper/112:05:201
2580399190,17cyclictest354-21systemd-journal10:35:001
2579599193,14cyclictest354-21systemd-journal12:30:010
2579599190,17cyclictest354-21systemd-journal09:25:000
2579599190,17cyclictest354-21systemd-journal07:35:220
2580399187,6cyclictest0-21swapper/107:56:271
2580399185,10cyclictest28496-21interrupts09:25:221
2580399180,2cyclictest0-21swapper/111:30:211
2580399180,1cyclictest0-21swapper/109:10:141
2580399180,16cyclictest354-21systemd-journal11:01:211
2579599184,9cyclictest0-21swapper/012:05:200
2579599180,16cyclictest354-21systemd-journal10:58:220
2579599180,16cyclictest354-21systemd-journal07:26:220
2580499170,15cyclictest354-21systemd-journal08:45:012
2580499170,15cyclictest354-21systemd-journal08:40:002
2580399176,6cyclictest298722sleep109:41:361
2580399174,7cyclictest31747-21irqstats08:40:201
2580399174,7cyclictest12777-21turbostat.cron07:55:001
2580399174,6cyclictest0-21swapper/109:01:381
2580399174,6cyclictest0-21swapper/108:10:491
2580399174,6cyclictest0-21swapper/107:17:351
2580399173,8cyclictest3900-21ssh10:20:231
2580399173,6cyclictest0-21swapper/109:38:401
2580399173,6cyclictest0-21swapper/108:29:431
2580399172,8cyclictest0-21swapper/109:32:481
2580399171,10cyclictest19779-21ssh12:25:241
2580399170,15cyclictest354-21systemd-journal12:30:221
2579599179,6cyclictest0-21swapper/010:06:050
2579599177,5cyclictest0-21swapper/010:30:260
25795991715,1cyclictest0-21swapper/009:30:200
25795991711,2cyclictest0-21swapper/012:25:170
2579599171,11cyclictest20340-21ssh11:51:520
2579599171,11cyclictest16942-21apt-get10:45:020
2579599170,16cyclictest354-21systemd-journal09:30:010
2579599170,15cyclictest354-21systemd-journal11:30:220
2579599170,15cyclictest354-21systemd-journal09:45:000
2579599170,15cyclictest354-21systemd-journal08:40:020
2579599170,15cyclictest354-21systemd-journal08:35:220
2579599170,15cyclictest354-21systemd-journal07:52:220
247782170,1sleep338-21rcuog/311:05:203
2580399165,6cyclictest0-21swapper/111:48:021
2580399165,6cyclictest0-21swapper/111:39:101
2580399165,6cyclictest0-21swapper/109:55:131
2580399165,6cyclictest0-21swapper/107:41:031
2580399163,8cyclictest0-21swapper/112:35:571
2580399163,8cyclictest0-21swapper/112:00:211
2580399162,12cyclictest24790-21tr12:10:251
2580399161,3cyclictest13337-21ntp_states12:20:231
2580399160,14cyclictest569-21systemd-logind08:15:251
2580399160,13cyclictest354-21systemd-journal07:40:001
2579599161,10cyclictest26596-21df_inode11:40:160
2579599161,10cyclictest25378-21munin-run09:04:590
2579599160,15cyclictest354-21systemd-journal10:00:000
2579599160,15cyclictest354-21systemd-journal08:45:080
2579599160,15cyclictest354-21systemd-journal08:02:220
2579599160,15cyclictest354-21systemd-journal08:02:220
2579599160,14cyclictest569-21systemd-logind08:50:240
2579599160,11cyclictest9848-21sh10:22:290
2580499150,13cyclictest354-21systemd-journal11:46:222
2580499150,13cyclictest354-21systemd-journal11:29:592
2580399154,6cyclictest7203-21ssh09:46:311
2580399154,6cyclictest0-21swapper/111:56:531
2580399154,6cyclictest0-21swapper/111:51:221
2580399154,6cyclictest0-21swapper/110:57:531
2580399154,6cyclictest0-21swapper/110:46:111
2580399154,6cyclictest0-21swapper/110:35:291
2580399154,6cyclictest0-21swapper/109:24:031
2580399154,6cyclictest0-21swapper/109:05:231
2580399154,6cyclictest0-21swapper/108:57:271
2580399154,6cyclictest0-21swapper/108:53:471
2580399154,6cyclictest0-21swapper/108:49:531
2580399154,6cyclictest0-21swapper/108:35:081
2580399154,6cyclictest0-21swapper/107:26:451
2580399154,4cyclictest0-21swapper/110:50:191
2580399152,8cyclictest9831-21awk11:15:001
2580399152,8cyclictest16943-21munin-run10:45:001
2580399152,6cyclictest27974-21ssh11:23:451
25803991513,1cyclictest0-21swapper/107:45:131
2580399150,7cyclictest0-21swapper/110:12:581
2580399150,10cyclictest30480-21ssh11:25:201
2579599156,1cyclictest111rcu_preempt11:00:190
2579599154,6cyclictest0-21swapper/012:14:080
2579599154,6cyclictest0-21swapper/011:15:200
2579599154,6cyclictest0-21swapper/008:05:380
2579599154,6cyclictest0-21swapper/008:05:370
2579599153,5cyclictest0-21swapper/010:15:010
2579599152,8cyclictest24307-21cstates11:55:220
2579599152,6cyclictest0-21swapper/011:08:010
2579599152,10cyclictest540-21dbus-daemon12:25:000
2579599152,10cyclictest20745-21if_enp0s2511:20:190
2579599150,7cyclictest8291-21/usr/sbin/munin08:20:240
2579599150,13cyclictest354-21systemd-journal09:15:000
2580499140,13cyclictest569-21systemd-logind07:50:242
2580499140,12cyclictest354-21systemd-journal10:20:002
2580399144,5cyclictest0-21swapper/108:21:491
2580399143,6cyclictest0-21swapper/110:25:211
2580399143,6cyclictest0-21swapper/110:25:211
2580399143,6cyclictest0-21swapper/110:03:551
2580399143,6cyclictest0-21swapper/108:32:191
2580399143,6cyclictest0-21swapper/108:00:001
2580399143,6cyclictest0-21swapper/108:00:001
2580399143,6cyclictest0-21swapper/107:31:501
2580399143,6cyclictest0-21swapper/107:20:171
2580399142,7cyclictest31255-21apt-get12:15:111
2579599146,6cyclictest0-21swapper/007:17:020
2579599146,3cyclictest28434-21gzip07:40:180
2579599144,5cyclictest0-21swapper/010:54:050
2579599143,6cyclictest25427-21munin-run10:15:000
2579599143,6cyclictest0-21swapper/009:05:440
2579599143,6cyclictest0-21swapper/008:10:040
2580499132,10cyclictest30835-21diskmemload09:12:562
2580499130,3cyclictest13552-21/usr/sbin/munin09:15:412
2580499130,12cyclictest354-21systemd-journal08:21:222
2580499130,12cyclictest354-21systemd-journal07:56:222
2580499130,11cyclictest354-21systemd-journal11:54:592
2580499130,11cyclictest354-21systemd-journal10:37:232
2580499130,11cyclictest25010-21ssh09:22:432
2580499130,11cyclictest18146-21ntpq08:25:232
2580499130,11cyclictest15090-21diskstats08:55:142
2580499130,11cyclictest10022-21irqstats12:20:192
2579599135,6cyclictest0-21swapper/009:37:210
2579599133,2cyclictest9-21ksoftirqd/009:50:350
2579599132,6cyclictest540-21dbus-daemon08:35:000
25795991311,1cyclictest0-21swapper/010:38:110
2579599130,8cyclictest9234-21tail12:35:220
2579599130,7cyclictest19451-21ssh10:28:060
2579599130,7cyclictest19451-21ssh10:28:050
2579599130,11cyclictest354-21systemd-journal12:04:480
27942120,1sleep30-21swapper/311:26:083
2580499129,2cyclictest9204-21ssh09:48:462
2580499122,9cyclictest0-21swapper/211:18:362
2580499120,2cyclictest6818-21sed07:45:262
2580499120,11cyclictest354-21systemd-journal08:45:072
2580499120,11cyclictest354-21systemd-journal08:14:232
2580499120,11cyclictest354-21systemd-journal08:04:222
2580499120,11cyclictest354-21systemd-journal08:04:222
2580499120,11cyclictest0-21swapper/211:41:012
2580499120,11cyclictest0-21swapper/209:35:422
2580499120,10cyclictest569-21systemd-logind07:40:252
2580499120,10cyclictest354-21systemd-journal12:35:002
2580499120,10cyclictest1461-21ssh10:52:122
2579599129,2cyclictest0-21swapper/008:25:160
2579599126,2cyclictest0-21swapper/008:15:260
2579599124,6cyclictest0-21swapper/011:10:260
2579599121,8cyclictest32258-21kthreadcore11:25:210
2579599121,6cyclictest0-21swapper/008:55:260
2579599120,10cyclictest354-21systemd-journal07:25:010
2580499119,1cyclictest29960-21ssh11:06:492
2580499119,1cyclictest18861-21ssh10:27:262
2580499119,1cyclictest18861-21ssh10:27:252
2580499119,1cyclictest0-21swapper/211:57:472
2580499118,2cyclictest8066-21apt-get10:40:122
2580499114,2cyclictest23877-21find08:30:252
2580499113,6cyclictest23974-21cat07:35:172
2580499112,7cyclictest354-21systemd-journal10:45:012
2580499110,2cyclictest19805-21ps12:25:242
2580499110,2cyclictest1706-21/usr/sbin/munin11:10:252
2580499110,2cyclictest0-21swapper/212:03:162
2580499110,1cyclictest5711-21ssh12:17:152
2580499110,1cyclictest11324-21ssh10:05:272
2580499110,1cyclictest0-21swapper/211:23:262
2580499110,10cyclictest354-21systemd-journal12:40:002
2580499110,10cyclictest354-21systemd-journal10:21:222
2580499110,10cyclictest354-21systemd-journal08:17:002
2580499110,10cyclictest354-21systemd-journal08:06:232
2580499110,10cyclictest354-21systemd-journal08:06:222
2580499110,10cyclictest354-21systemd-journal07:22:222
2580499110,10cyclictest16496-21ssh10:10:162
2580499110,10cyclictest0-21swapper/209:44:212
2580499110,10cyclictest0-21swapper/209:30:082
2580499110,10cyclictest0-21swapper/209:00:252
281632100,0sleep30-21swapper/312:12:163
2580499109,1cyclictest0-21swapper/209:26:202
2580499108,1cyclictest0-21swapper/212:10:112
2580499100,9cyclictest354-21systemd-journal09:07:232
2580499100,9cyclictest354-21systemd-journal07:19:552
2580499100,9cyclictest0-21swapper/209:52:002
2580499100,9cyclictest0-21swapper/208:50:182
2580499100,1cyclictest20976-21ssh11:02:312
2580499100,1cyclictest0-21swapper/210:31:302
184242100,7sleep30-21swapper/308:25:263
258049991,7cyclictest4836-21df_inode10:55:142
258049991,3cyclictest1849-21ntp_states10:00:292
4862280,0sleep30-21swapper/310:36:403
258049980,7cyclictest0-21swapper/207:25:162
20175280,2sleep3113-21kworker/3:108:30:183
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
none14:37:267
19274270,4sleep30-21swapper/309:54:333
13480270,1sleep30-21swapper/310:59:563
11593270,2sleep3113-21kworker/3:110:05:303
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
none14:37:266
8083260,0sleep30-21swapper/311:13:063
4807263,1sleep30-21swapper/312:16:213
32455260,3sleep30-21swapper/310:50:383
26114260,0sleep30-21swapper/309:23:593
25765260,3sleep30-21swapper/312:27:273
25353260,0sleep30-21swapper/309:04:563
21504260,3sleep30-21swapper/310:30:073
17412260,4sleep30-21swapper/310:25:503
17412260,4sleep30-21swapper/310:25:503
14573260,4sleep30-21swapper/311:33:343
1356260,4sleep30-21swapper/312:00:063
12969260,0sleep30-21swapper/309:34:103
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
none14:37:265
30299250,0sleep30-21swapper/309:42:073
29378253,0sleep30-21swapper/311:55:513
25545250,0sleep30-21swapper/311:39:553
23685250,0sleep30-21swapper/308:04:553
23685250,0sleep30-21swapper/308:04:553
20563250,3sleep30-21swapper/312:09:403
17256250,3sleep30-21swapper/312:23:553
1676250,2sleep30-21swapper/307:45:003
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
none14:37:264
8445240,1sleep30-21swapper/309:47:573
4047240,2sleep30-21swapper/312:32:523
31161240,0sleep30-21swapper/307:14:563
29153240,0sleep30-21swapper/308:09:563
29153240,0sleep30-21swapper/308:09:563
2863240,1sleep30-21swapper/310:01:023
26979240,1sleep30-21swapper/311:22:403
25400240,1sleep30-21swapper/310:15:013
2182240,1sleep30-21swapper/308:15:013
2077240,3sleep30-21swapper/308:13:403
19875240,0sleep30-21swapper/308:59:553
19741240,2sleep30-21swapper/311:51:173
17333240,0sleep30-21swapper/307:29:463
12079240,0sleep30-21swapper/307:25:003
7640230,0sleep30-21swapper/310:40:003
7286230,0sleep30-21swapper/307:50:013
6099230,0sleep30-21swapper/312:35:013
4146230,1sleep30-21swapper/309:10:453
3412230,0sleep30-21swapper/308:45:013
28753230,1sleep30-21swapper/309:25:243
26161230,1sleep30-21swapper/311:40:163
25771230,1sleep30-21swapper/310:15:083
2547230,1sleep30-21swapper/310:20:013
24772230,1sleep30-21swapper/308:35:123
24030230,1sleep30-21swapper/307:35:193
19708230,0sleep30-21swapper/309:55:013
19607230,1sleep30-21swapper/311:01:013
18508230,1sleep30-21swapper/307:30:223
17681230,1sleep30-21swapper/310:45:143
14193230,1sleep30-21swapper/309:35:133
14058230,2sleep30-21swapper/308:50:343
8180220,0sleep30-21swapper/308:20:013
30622220,0sleep30-21swapper/308:40:123
1568220,0sleep30-21swapper/307:15:163
13067220,0sleep30-21swapper/307:55:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional