You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-07 - 02:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

x86 Intel Core i7-E610 @2530 MHz, Linux 6.3.1-rt13 (Profile)

Latency plot of shadow in rack #5, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot4s.osadl.org (updated Wed Jun 07, 2023 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1487599145136,8cyclictest0-21swapper/019:14:220
1487599145136,8cyclictest0-21swapper/019:14:220
144452117103,9sleep30-21swapper/319:06:483
146072116103,10sleep20-21swapper/219:08:522
13605210894,10sleep00-21swapper/019:05:250
9987210794,9sleep10-21swapper/119:05:181
14880997775,1cyclictest0-21swapper/219:14:222
14880997775,1cyclictest0-21swapper/219:14:222
14880994238,3cyclictest4737-21kworker/u16:1+events_unbound20:40:002
14880994036,3cyclictest4737-21kworker/u16:1+events_unbound23:45:322
14880994035,3cyclictest4737-21kworker/u16:1+events_unbound19:15:012
14880994035,3cyclictest4737-21kworker/u16:1+events_unbound19:15:012
14877993732,3cyclictest4737-21kworker/u16:1+events_unbound00:00:031
14880993632,3cyclictest4737-21kworker/u16:1+events_unbound19:35:242
14877993531,3cyclictest4737-21kworker/u16:1+events_unbound23:20:021
14880993430,3cyclictest23015-21kworker/u16:2+events_unbound21:40:012
14880993329,3cyclictest4737-21kworker/u16:1+events_unbound20:35:162
14880993329,3cyclictest23015-21kworker/u16:2+events_unbound22:45:332
14880993329,3cyclictest23015-21kworker/u16:2+events_unbound19:45:282
14880993229,2cyclictest23015-21kworker/u16:2+events_unbound23:00:342
14880993128,2cyclictest4737-21kworker/u16:1+events_unbound21:45:202
14880993127,3cyclictest4737-21kworker/u16:1+events_unbound23:55:232
14880993127,3cyclictest4737-21kworker/u16:1+events_unbound21:00:192
14880993127,2cyclictest4737-21kworker/u16:1+events_unbound22:50:242
14880993124,3cyclictest23015-21kworker/u16:2+events_unbound19:25:322
14877993127,3cyclictest23015-21kworker/u16:2+events_unbound21:40:361
14880993026,3cyclictest4737-21kworker/u16:1+events_unbound23:25:292
14880993026,3cyclictest4737-21kworker/u16:1+events_unbound22:00:262
14880993026,3cyclictest23015-21kworker/u16:2+events_unbound20:55:262
14877993027,2cyclictest23015-21kworker/u16:2+events_unbound20:20:001
14880992926,2cyclictest23015-21kworker/u16:2+events_unbound19:31:492
14880992925,3cyclictest4737-21kworker/u16:1+events_unbound19:20:332
14880992925,3cyclictest23015-21kworker/u16:2+events_unbound21:50:322
14880992925,3cyclictest23015-21kworker/u16:2+events_unbound21:30:232
14880992824,3cyclictest4737-21kworker/u16:1+events_unbound22:40:252
14880992824,3cyclictest23015-21kworker/u16:2+events_unbound22:30:222
14880992824,3cyclictest23015-21kworker/u16:2+events_unbound20:10:292
14880992723,3cyclictest4737-21kworker/u16:1+events_unbound23:20:282
14880992723,3cyclictest4737-21kworker/u16:1+events_unbound23:05:272
14880992723,3cyclictest4737-21kworker/u16:1+events_unbound21:05:342
14880992723,3cyclictest4737-21kworker/u16:1+events_unbound20:15:262
14880992723,3cyclictest4737-21kworker/u16:1+events_unbound00:10:262
14880992723,3cyclictest4737-21kworker/u16:1+events_unbound00:00:242
14880992723,3cyclictest23015-21kworker/u16:2+events_unbound22:35:462
14880992723,3cyclictest23015-21kworker/u16:2+events_unbound00:35:252
14877992722,2cyclictest0-21swapper/119:14:221
14877992722,2cyclictest0-21swapper/119:14:221
14880992623,2cyclictest4737-21kworker/u16:1+events_unbound21:20:242
14880992622,3cyclictest4737-21kworker/u16:1+events_unbound22:25:182
14880992622,3cyclictest4737-21kworker/u16:1+events_unbound22:15:532
14880992622,3cyclictest4737-21kworker/u16:1+events_unbound19:50:332
14880992622,3cyclictest23015-21kworker/u16:2+events_unbound23:15:282
14880992622,3cyclictest23015-21kworker/u16:2+events_unbound19:55:202
14880992622,3cyclictest23015-21kworker/u16:2+events_unbound00:20:392
14875992618,7cyclictest27496-21cron23:45:000
14880992521,3cyclictest4737-21kworker/u16:1+events_unbound20:45:292
14880992521,3cyclictest4737-21kworker/u16:1+events_unbound20:00:232
14880992521,3cyclictest23015-21kworker/u16:2+events_unbound23:50:172
14880992520,4cyclictest23015-21kworker/u16:2+events_unbound22:10:212
14877992521,3cyclictest23015-21kworker/u16:2+events_unbound23:50:311
14877992521,3cyclictest23015-21kworker/u16:2+events_unbound21:09:481
14877992520,4cyclictest4737-21kworker/u16:1+events_unbound20:05:301
14880992420,3cyclictest4737-21kworker/u16:1+events_unbound21:10:352
14877992420,3cyclictest4737-21kworker/u16:1+events_unbound21:20:011
14880992320,3cyclictest23015-21kworker/u16:2+events_unbound23:40:262
14880992320,2cyclictest23015-21kworker/u16:2+events_unbound20:20:312
14875992316,6cyclictest11470-21munin-run00:00:010
14880992218,3cyclictest4737-21kworker/u16:1+events_unbound23:35:332
14880992217,4cyclictest4737-21kworker/u16:1+events_unbound22:55:172
14877992218,3cyclictest4737-21kworker/u16:1+events_unbound19:35:211
14877992218,3cyclictest23015-21kworker/u16:2+events_unbound23:00:301
14877992218,3cyclictest23015-21kworker/u16:2+events_unbound20:55:241
14880992117,3cyclictest4737-21kworker/u16:1+events_unbound20:34:492
14880992117,3cyclictest23015-21kworker/u16:2+events_unbound22:05:332
14880992117,3cyclictest23015-21kworker/u16:2+events_unbound00:27:502
1487799213,14cyclictest303-21tr19:50:281
1487799212,16cyclictest22789-21munin-run19:45:001
14877992117,3cyclictest4737-21kworker/u16:1+events_unbound20:35:281
14875992116,3cyclictest791-21apt23:50:160
14880992016,3cyclictest23015-21kworker/u16:2+events_unbound00:30:272
1487799204,11cyclictest25970-21munin-run22:45:001
1487799203,13cyclictest25537-21/usr/sbin/munin22:15:001
14877992016,3cyclictest4737-21kworker/u16:1+events_unbound23:17:491
14877992016,3cyclictest23015-21kworker/u16:2+events_unbound22:30:301
14877992016,3cyclictest23015-21kworker/u16:2+events_unbound20:50:301
1487599205,14cyclictest1018-21awk00:20:000
1487599205,10cyclictest724-21runrttasks20:01:170
1487599204,5cyclictest0-21swapper/021:25:290
14880991916,3cyclictest23015-21kworker/u16:2+events_unbound21:55:272
14880991915,3cyclictest4737-21kworker/u16:1+events_unbound19:40:252
14880991915,3cyclictest23015-21kworker/u16:2+events_unbound23:30:282
14880991915,3cyclictest23015-21kworker/u16:2+events_unbound21:25:202
1487799198,6cyclictest0-21swapper/119:32:461
14877991915,3cyclictest4737-21kworker/u16:1+events_unbound21:00:011
14877991915,3cyclictest4737-21kworker/u16:1+events_unbound20:00:021
14877991915,3cyclictest4737-21kworker/u16:1+events_unbound19:15:171
14877991915,3cyclictest4737-21kworker/u16:1+events_unbound19:15:171
14877991915,3cyclictest0-21swapper/122:55:171
14877991914,4cyclictest4737-21kworker/u16:1+events_unbound20:45:261
14877991914,4cyclictest23015-21kworker/u16:2+events_unbound22:05:361
14875991915,2cyclictest0-21swapper/020:15:160
1487599190,16cyclictest0-21swapper/022:55:170
14880991815,2cyclictest23015-21kworker/u16:2+events_unbound20:50:012
14880991814,3cyclictest4737-21kworker/u16:1+events_unbound23:10:232
14880991814,3cyclictest4737-21kworker/u16:1+events_unbound20:08:502
14880991814,3cyclictest23015-21kworker/u16:2+events_unbound21:15:302
1487799185,8cyclictest0-21swapper/119:22:521
1487799183,10cyclictest1074-21latency_hist00:20:001
1487799182,13cyclictest20896-21ls23:35:281
1487799182,11cyclictest4057-21munin-plugin-st22:25:001
1487799182,10cyclictest23255-21munin-run00:40:011
14877991815,2cyclictest23015-21kworker/u16:2+events_unbound23:05:001
1487799181,13cyclictest4310-21apt-get22:25:141
1487799180,16cyclictest0-21swapper/120:15:161
1487599180,8cyclictest0-21swapper/022:51:480
14880991713,3cyclictest4737-21kworker/u16:1+events_unbound21:35:282
14880991713,3cyclictest4737-21kworker/u16:1+events_unbound00:05:352
14880991713,3cyclictest23015-21kworker/u16:2+events_unbound00:15:502
1487799178,8cyclictest11935-21/usr/sbin/munin00:30:001
1487799173,11cyclictest26159-21sshd23:12:481
14877991713,3cyclictest4737-21kworker/u16:1+events_unbound20:40:331
14877991713,3cyclictest23015-21kworker/u16:2+events_unbound00:20:021
1487799171,11cyclictest32039-21expr22:50:181
1487799170,1cyclictest0-21swapper/100:10:201
1487799170,16cyclictest0-21swapper/121:35:221
1487599174,9cyclictest0-21swapper/019:41:480
1487599174,12cyclictest0-21swapper/021:35:010
1487599174,11cyclictest0-21swapper/019:25:240
1487599172,4cyclictest0-21swapper/021:40:210
1487599171,9cyclictest0-21swapper/023:25:230
1487599171,4cyclictest0-21swapper/021:50:160
1487599170,2cyclictest0-21swapper/020:35:170
1487599170,16cyclictest15224-21date22:35:000
234162160,1chrt0-21swapper/319:45:153
1487799164,10cyclictest0-21swapper/119:25:071
1487799162,11cyclictest15614-21ntp_states23:30:281
1487799162,10cyclictest25555-21awk21:45:201
14877991612,3cyclictest23015-21kworker/u16:2+events_unbound22:35:351
14877991612,3cyclictest23015-21kworker/u16:2+events_unbound21:15:021
1487799160,11cyclictest21753-21/usr/sbin/munin00:05:341
1487599167,3cyclictest30945-21grep23:15:330
1487599164,8cyclictest22631-21apt-get19:15:160
1487599164,8cyclictest22631-21apt-get19:15:160
1487599164,4cyclictest23452-21sh00:10:250
1487599163,8cyclictest0-21swapper/023:05:240
1487599162,3cyclictest0-21swapper/023:30:160
1487599162,3cyclictest0-21swapper/019:20:190
1487599162,13cyclictest0-21swapper/000:05:200
1487599161,3cyclictest0-21swapper/021:05:190
14875991612,3cyclictest9511-21cron22:30:000
14875991610,5cyclictest13611-21needreboot22:00:280
14875991610,3cyclictest0-21swapper/021:35:010
1487599160,9cyclictest0-21swapper/019:55:310
1487599160,11cyclictest15420-21munin-plugin-st23:04:590
1487799157,7cyclictest5831-21apt-get23:25:161
1487799157,7cyclictest23015-21kworker/u16:2+flush-8:023:40:301
1487799155,9cyclictest12065-21kthreadcore22:00:271
1487799155,8cyclictest0-21swapper/122:16:521
1487799154,7cyclictest13676-21irqstats00:30:291
1487799152,8cyclictest8474-21cut20:30:221
1487799152,10cyclictest23797-21if_enp0s2519:45:181
14877991513,1cyclictest23015-21kworker/u16:2+events_unbound21:55:201
14877991512,2cyclictest24349-21apt21:15:001
1487599157,2cyclictest17380-21unixbench_singl00:30:400
1487599155,5cyclictest0-21swapper/021:20:260
1487599154,8cyclictest7400-21apt-get20:30:150
1487599154,4cyclictest309-21systemd-journal20:45:220
1487599154,10cyclictest0-21swapper/022:15:410
1487599153,4cyclictest309-21systemd-journal23:10:250
1487599153,4cyclictest309-21systemd-journal00:00:360
1487599151,4cyclictest0-21swapper/020:50:150
14875991511,3cyclictest23323-21cut19:45:150
1487599150,8cyclictest5969-21kthreadcore21:55:280
1487599150,8cyclictest29553-21grep22:45:280
1487599150,7cyclictest1935-21gltestperf00:20:340
1487599150,4cyclictest20605-21kthreadcore20:10:220
1487799145,8cyclictest19074-21irqrtprio20:10:211
1487799144,5cyclictest0-21swapper/123:56:501
14877991411,2cyclictest8334-21munin-run21:30:011
1487799140,6cyclictest6742-21cron20:00:001
1487599147,2cyclictest0-21swapper/020:40:270
1487599146,2cyclictest0-21swapper/021:10:270
1487599145,2cyclictest0-21swapper/023:20:320
1487599144,8cyclictest0-21swapper/022:05:100
1487599144,8cyclictest0-21swapper/020:55:080
1487599144,5cyclictest0-21swapper/023:35:240
1487599144,2cyclictest0-21swapper/022:10:330
1487599143,7cyclictest31277-21apt-get22:20:190
1487599143,4cyclictest0-21swapper/020:25:300
1487599142,5cyclictest0-21swapper/022:40:330
1487599142,5cyclictest0-21swapper/021:45:150
1487599141,4cyclictest0-21swapper/021:15:190
1487599141,2cyclictest0-21swapper/020:20:270
1487599141,2cyclictest0-21swapper/020:05:220
14875991411,2cyclictest13105-21irqrtprio19:35:230
1487799138,4cyclictest2744-21ntpq21:50:301
1487799133,5cyclictest0-21swapper/122:45:251
1487799132,8cyclictest0-21swapper/123:45:041
1487799131,10cyclictest3119-21kthreadcore20:25:241
1487799130,10cyclictest9020-21diskstats21:30:221
1487599137,1cyclictest0-21swapper/022:30:160
1487599135,2cyclictest0-21swapper/000:25:300
1487599134,3cyclictest10477-21kthreadcore19:30:290
1487599132,6cyclictest28697-21grep23:45:250
1487599132,10cyclictest0-21swapper/000:35:150
1487599131,8cyclictest0-21swapper/021:01:130
1487599131,2cyclictest0-21swapper/019:52:230
1488099129,3cyclictest4737-21kworker/u16:1+events_unbound20:25:492
14880991210,2cyclictest23015-21kworker/u16:2+events_unbound22:21:502
122542110,1chrt0-21swapper/323:30:233
26822280,5sleep30-21swapper/323:15:013
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
25991270,2sleep30-21swapper/323:10:423
24780270,2sleep30-21swapper/321:40:393
14056270,5sleep30-21swapper/321:35:223
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
789260,4sleep30-21swapper/323:50:163
30868260,4sleep30-21swapper/321:50:183
28116260,4sleep30-21swapper/319:20:193
1935260,4sleep30-21swapper/320:25:163
18719260,4sleep30-21swapper/320:40:203
17940260,4sleep30-21swapper/320:10:133
15666260,4sleep30-21swapper/323:05:163
15261260,2sleep30-21swapper/323:03:113
14860260,4sleep30-21swapper/322:05:203
12861260,4sleep30-21swapper/320:35:143
1262260,2sleep30-21swapper/300:20:233
12479260,4sleep30-21swapper/320:05:163
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
none08:51:275
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional