You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-20 - 16:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

x86 Intel Core i7-E610 @2530 MHz, Linux 5.4.17-rt9 (Profile)

Latency plot of shadow in rack #5, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rack5slot4s.osadl.org (updated Mon Mar 20, 2023 12:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1739299147138,8cyclictest0-21swapper/007:13:490
2747821380,0sleep30-21swapper/309:41:143
17166212054,11sleep10-21swapper/107:09:341
171962116102,11sleep20-21swapper/207:09:552
17120210793,11sleep00-21swapper/007:08:570
304422790,1sleep1201rcuc/112:35:291
124282760,1sleep30-21swapper/311:24:393
17397997472,1cyclictest0-21swapper/107:13:501
32572730,0sleep20-21swapper/211:04:422
195242730,0sleep30-21swapper/311:42:513
17402997372,1cyclictest0-21swapper/207:13:492
217432720,0sleep30-21swapper/312:30:263
170702720,0sleep00-21swapper/009:36:070
314062700,0sleep20-21swapper/210:30:252
1701927061,6sleep30-21swapper/307:07:403
1739299349,12cyclictest0-21swapper/011:51:460
311132330,0sleep1201rcuc/111:16:201
17397993121,8cyclictest21-21ksoftirqd/108:16:391
1739299314,20cyclictest0-21swapper/009:49:450
17392992619,5cyclictest21507-31updatedb.mlocat07:40:180
17397992515,8cyclictest21-21ksoftirqd/111:57:261
135162240,0sleep30-21swapper/312:10:303
223362220,1sleep222340-21kthreadcore12:15:222
207382220,1sleep120288-21gzip07:40:131
1739799223,14cyclictest0-21swapper/112:32:421
17392992212,9cyclictest0-21swapper/012:35:250
1739799211,7cyclictest20339-21apt07:40:011
1739299212,14cyclictest5499-21basename07:55:010
1739299210,19cyclictest352-21systemd-journal08:45:000
284292200,0sleep20-21swapper/209:42:092
1740299200,19cyclictest538-21systemd-logind11:35:252
1739799201,13cyclictest111rcu_preempt10:17:081
1739299200,19cyclictest352-21systemd-journal11:10:010
1739299200,19cyclictest352-21systemd-journal11:10:000
1739299200,18cyclictest352-21systemd-journal12:00:430
155632200,0sleep09-21ksoftirqd/010:23:060
1739799199,8cyclictest12095-21sh11:24:191
1739799194,8cyclictest0-21swapper/109:16:441
17397991910,8cyclictest21-21ksoftirqd/108:50:161
1739799190,9cyclictest111rcu_preempt12:07:571
1739799190,17cyclictest352-21systemd-journal11:30:201
1739799190,17cyclictest352-21systemd-journal10:23:021
1740299180,16cyclictest352-21systemd-journal11:31:022
1740299180,16cyclictest352-21systemd-journal10:50:322
1739799184,6cyclictest0-21swapper/108:10:251
1739799182,11cyclictest5492-21latency_hist07:55:001
17397991810,5cyclictest21-21ksoftirqd/111:27:571
1739799180,17cyclictest352-21systemd-journal08:02:331
17392991814,3cyclictest13276-21ssh11:25:140
1739299181,16cyclictest0-21swapper/010:40:140
1739299180,2cyclictest0-21swapper/009:30:220
1739299180,16cyclictest538-21systemd-logind07:15:290
1739299180,16cyclictest352-21systemd-journal07:28:420
178012170,0sleep10-21swapper/109:20:331
1740299170,15cyclictest352-21systemd-journal11:10:012
1739799177,5cyclictest24064-21ssh10:58:341
1739799174,8cyclictest0-21swapper/111:44:421
17397991713,3cyclictest22838-21ssh10:41:061
1739799171,11cyclictest5108-21ssh10:01:531
1739799170,15cyclictest538-21systemd-logind10:31:171
1739799170,12cyclictest31445-21awk09:44:591
1739299174,8cyclictest23837-21diskmemload10:19:020
1739299174,6cyclictest0-21swapper/010:57:170
1739299174,6cyclictest0-21swapper/009:21:170
1739299174,6cyclictest0-21swapper/008:49:580
1739299174,6cyclictest0-21swapper/007:35:460
1739299170,16cyclictest352-21systemd-journal09:59:330
1740299160,15cyclictest352-21systemd-journal09:04:322
1739799165,6cyclictest0-21swapper/109:50:281
1739799165,6cyclictest0-21swapper/107:24:581
1739799164,8cyclictest0-21swapper/108:20:001
1739799164,7cyclictest0-21swapper/110:50:181
1739799163,8cyclictest0-21swapper/110:47:171
1739799163,8cyclictest0-21swapper/109:05:521
1739799163,8cyclictest0-21swapper/108:42:271
1739799163,8cyclictest0-21swapper/108:26:481
1739799163,8cyclictest0-21swapper/107:49:541
1739799163,8cyclictest0-21swapper/107:30:331
1739799163,8cyclictest0-21swapper/107:17:571
1739799160,1cyclictest0-21swapper/110:05:211
1739799160,15cyclictest352-21systemd-journal08:07:021
1739299165,6cyclictest0-21swapper/011:42:280
1739299165,6cyclictest0-21swapper/011:05:060
1739299165,6cyclictest0-21swapper/009:44:390
1739299165,6cyclictest0-21swapper/008:00:530
1739299165,10cyclictest0-21swapper/008:25:190
1739299163,8cyclictest14777-21munin-run07:35:000
17392991614,1cyclictest0-21swapper/008:10:120
1739299160,15cyclictest352-21systemd-journal11:23:030
1739299160,15cyclictest352-21systemd-journal08:23:320
1739299160,14cyclictest352-21systemd-journal12:16:330
1739299160,13cyclictest13743-21ssh10:37:410
69152150,0sleep30-21swapper/312:24:023
175102150,0sleep228-21ksoftirqd/210:08:412
1740299150,14cyclictest352-21systemd-journal12:23:332
1740299150,14cyclictest352-21systemd-journal11:24:552
1740299150,14cyclictest352-21systemd-journal10:48:322
1740299150,14cyclictest352-21systemd-journal09:58:022
1740299150,14cyclictest352-21systemd-journal07:49:562
1740299150,14cyclictest352-21systemd-journal07:40:022
1740299150,13cyclictest352-21systemd-journal09:20:002
1740299150,13cyclictest32527-21/usr/sbin/munin08:15:222
1739799157,6cyclictest21-21ksoftirqd/108:45:231
1739799155,5cyclictest0-21swapper/112:26:361
1739799155,5cyclictest0-21swapper/110:36:021
1739799154,8cyclictest10444-21ntp_states07:55:261
1739799154,7cyclictest0-21swapper/108:30:461
1739799154,6cyclictest20837-21ssh10:10:221
1739799154,6cyclictest0-21swapper/112:20:061
1739799154,6cyclictest0-21swapper/111:45:121
1739799154,6cyclictest0-21swapper/110:25:221
1739799154,6cyclictest0-21swapper/109:45:491
1739799154,6cyclictest0-21swapper/109:10:201
1739799154,6cyclictest0-21swapper/108:35:341
1739799153,8cyclictest0-21swapper/111:35:481
1739799152,8cyclictest3569-21apt-get11:05:021
1739799152,8cyclictest23789-21hddtemp_smartct09:25:171
1739799152,8cyclictest16455-21grep11:10:291
1739799152,8cyclictest16455-21grep11:10:281
1739799152,6cyclictest0-21swapper/109:59:391
1739799150,13cyclictest352-21systemd-journal11:00:331
1739299155,5cyclictest0-21swapper/010:11:070
1739299154,6cyclictest0-21swapper/012:08:200
1739299154,6cyclictest0-21swapper/010:26:250
1739299154,6cyclictest0-21swapper/010:05:160
1739299154,6cyclictest0-21swapper/009:27:410
1739299154,6cyclictest0-21swapper/009:12:410
1739299154,6cyclictest0-21swapper/009:05:500
1739299154,6cyclictest0-21swapper/009:00:100
1739299154,6cyclictest0-21swapper/008:56:320
1739299154,6cyclictest0-21swapper/008:51:310
1739299154,6cyclictest0-21swapper/008:05:540
1739299154,6cyclictest0-21swapper/007:55:230
1739299154,10cyclictest0-21swapper/009:16:410
1739299152,8cyclictest2926-21/usr/sbin/munin10:00:270
1739299152,10cyclictest6664-21users11:35:280
1739299150,14cyclictest352-21systemd-journal12:30:330
1739299150,14cyclictest352-21systemd-journal11:56:330
1739299150,14cyclictest352-21systemd-journal10:30:010
1739299150,10cyclictest0-21swapper/012:15:000
1740299140,13cyclictest352-21systemd-journal09:12:022
1740299140,13cyclictest352-21systemd-journal08:56:022
1739799144,3cyclictest0-21swapper/108:55:141
1739799143,6cyclictest0-21swapper/112:10:011
1739799143,6cyclictest0-21swapper/112:02:271
1739799143,6cyclictest0-21swapper/109:35:211
1739799143,6cyclictest0-21swapper/109:30:221
1739799141,6cyclictest0-21swapper/112:15:051
1739799141,6cyclictest0-21swapper/109:00:151
1739299144,5cyclictest0-21swapper/011:15:200
1739299144,5cyclictest0-21swapper/009:50:190
1739299143,7cyclictest0-21swapper/010:45:420
1739299143,6cyclictest0-21swapper/011:45:270
1739299143,6cyclictest0-21swapper/010:51:200
1739299143,6cyclictest0-21swapper/008:30:130
1739299143,6cyclictest0-21swapper/008:19:570
1739299143,6cyclictest0-21swapper/007:47:170
1739299143,6cyclictest0-21swapper/007:21:580
1739299142,9cyclictest0-21swapper/011:30:000
1739299140,12cyclictest352-21systemd-journal12:25:340
1740299130,3cyclictest32080-21ssh11:17:162
1740299130,12cyclictest352-21systemd-journal07:24:552
1739799133,7cyclictest0-21swapper/107:25:031
1739799133,5cyclictest0-21swapper/111:50:021
1739299132,8cyclictest0-21swapper/008:38:430
1739299131,7cyclictest30440-21ssh12:20:150
17402991210,1cyclictest1024-21apt-get09:30:182
1740299120,2cyclictest22554-21ssh09:24:592
1740299120,2cyclictest15218-21awk07:35:152
1740299120,2cyclictest14774-21ssh10:22:212
1740299120,11cyclictest538-21systemd-logind11:50:302
1740299120,11cyclictest352-21systemd-journal12:37:332
1740299120,11cyclictest352-21systemd-journal12:08:332
1740299120,11cyclictest352-21systemd-journal11:57:032
1740299120,11cyclictest352-21systemd-journal09:40:002
1740299120,11cyclictest0-21swapper/212:30:132
1740299120,11cyclictest0-21swapper/210:15:032
1739299120,8cyclictest23837-21diskmemload11:01:030
259572110,6sleep30-21swapper/307:43:173
1740299118,2cyclictest19424-21ssh11:10:312
1740299118,2cyclictest19424-21ssh11:10:312
17402991110,1cyclictest0-21swapper/211:25:052
1740299110,9cyclictest352-21systemd-journal08:40:002
1740299110,1cyclictest0-21swapper/209:47:382
1740299110,10cyclictest352-21systemd-journal11:00:002
1740299110,10cyclictest352-21systemd-journal10:04:552
1740299110,10cyclictest352-21systemd-journal09:52:022
1740299110,10cyclictest352-21systemd-journal07:19:322
1740299110,10cyclictest24640-21ssh10:42:492
1740299110,10cyclictest16886-21timerwakeupswit11:40:282
1740299110,10cyclictest0-21swapper/212:28:252
1740299110,10cyclictest0-21swapper/212:11:482
1740299110,10cyclictest0-21swapper/210:10:082
1740299110,10cyclictest0-21swapper/209:25:192
1740299110,10cyclictest0-21swapper/208:50:212
255382100,2sleep225556-21sh10:27:462
1740299100,9cyclictest352-21systemd-journal11:45:002
1740299100,9cyclictest352-21systemd-journal08:48:022
1740299100,9cyclictest352-21systemd-journal08:44:322
1740299100,9cyclictest352-21systemd-journal08:01:322
1740299100,9cyclictest352-21systemd-journal07:56:322
1740299100,9cyclictest352-21systemd-journal07:50:022
1740299100,9cyclictest352-21systemd-journal07:25:332
1740299100,9cyclictest0-21swapper/212:01:522
1740299100,9cyclictest0-21swapper/210:35:122
1740299100,9cyclictest0-21swapper/208:25:152
1740299100,9cyclictest0-21swapper/207:30:262
174029998,1cyclictest0-21swapper/208:10:252
174029992,6cyclictest14863-21kthreadcore08:30:212
174029991,3cyclictest17648-21df_inode08:05:152
174029990,8cyclictest352-21systemd-journal09:06:032
174029990,8cyclictest352-21systemd-journal08:24:342
15143290,1sleep30-21swapper/309:50:393
29551280,0sleep30-21swapper/312:03:333
26962280,0sleep30-21swapper/308:40:203
14712280,1sleep30-21swapper/310:54:313
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
32204260,1sleep3111-21kworker/3:107:20:203
11029260,0sleep3341rcuc/309:35:023
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
6389251,2sleep30-21swapper/312:39:563
4035251,2sleep30-21swapper/307:25:143
31120251,2sleep30-21swapper/309:12:103
27752250,0sleep3341rcuc/310:45:203
27562250,0sleep3341rcuc/309:57:373
24255251,2sleep30-21swapper/312:15:243
21049251,2sleep30-21swapper/310:55:393
16956250,2sleep30-21swapper/308:05:003
16179250,2sleep30-21swapper/310:40:003
11933251,2sleep30-21swapper/310:36:013
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
none16:00:324
8216240,2sleep30-21swapper/309:16:233
6283240,2sleep30-21swapper/309:47:043
4980240,2sleep30-21swapper/311:50:293
3553240,2sleep30-21swapper/311:05:013
3532240,2sleep30-21swapper/311:35:223
31599240,2sleep30-21swapper/312:05:193
30944240,2sleep30-21swapper/311:32:413
29435240,2sleep30-21swapper/311:47:073
26761240,2sleep30-21swapper/311:15:223
26435240,2sleep30-21swapper/307:45:013
25440240,2sleep30-21swapper/308:10:223
22915240,2sleep30-21swapper/307:15:013
22122240,2sleep30-21swapper/311:12:343
22122240,2sleep30-21swapper/311:12:343
1917240,2sleep30-21swapper/308:20:223
18800240,2sleep30-21swapper/308:05:203
18490240,2sleep30-21swapper/311:25:333
18462240,2sleep30-21swapper/308:35:173
17996240,2sleep30-21swapper/311:57:253
1668240,2sleep30-21swapper/310:31:033
15616240,2sleep30-21swapper/310:23:103
15413240,2sleep30-21swapper/310:06:433
14081240,2sleep30-21swapper/312:25:583
14031240,3sleep30-21swapper/307:30:283
12566240,2sleep30-21swapper/309:20:153
11318240,2sleep30-21swapper/309:35:183
7252231,1sleep30-21swapper/308:54:403
7175230,2sleep30-21swapper/310:03:503
6967230,2sleep30-21swapper/307:55:243
32046230,2sleep30-21swapper/311:01:163
30121231,1sleep30-21swapper/308:45:263
29225230,1sleep30-21swapper/310:15:003
28681230,1sleep30-21swapper/309:26:003
21811230,1sleep30-21swapper/307:10:243
20312230,1sleep30-21swapper/307:39:523
19167230,1sleep30-21swapper/310:10:043
18326230,1sleep30-21swapper/309:05:013
17904230,2sleep30-21swapper/310:25:063
13294230,2sleep30-21swapper/309:00:173
12458231,1sleep30-21swapper/308:55:433
12059231,1sleep30-21swapper/308:29:403
32624220,1sleep30-21swapper/307:50:023
28231220,1sleep30-21swapper/308:15:093
12338220,1sleep30-21swapper/308:30:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional