You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-23 - 22:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Tue Apr 23, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
829199250,24cyclictest0-21swapper/310:26:193
829199250,1cyclictest0-21swapper/309:55:433
828799250,24cyclictest0-21swapper/212:00:492
8276992525,0cyclictest1597-21diskmemload10:55:360
8291992422,1cyclictest11475-21taskset07:17:273
829199240,23cyclictest618-21gdbus08:25:003
829199240,23cyclictest23741-21kworker/u8:011:50:353
829199240,23cyclictest2127-21chrt09:40:443
829199240,23cyclictest0-21swapper/309:11:013
829199240,1cyclictest0-21swapper/309:39:343
829199240,0cyclictest0-21swapper/312:17:053
8287992422,1cyclictest0-21swapper/210:50:002
828799240,23cyclictest1633-21munin-run09:10:002
828799240,23cyclictest1597-21diskmemload09:12:572
828799240,23cyclictest0-21swapper/211:13:162
828799240,1cyclictest0-21swapper/211:55:002
828799240,0cyclictest1597-21diskmemload09:51:012
8284992423,1cyclictest0-21swapper/112:17:011
828499240,23cyclictest20882-21ssh09:27:341
8276992423,0cyclictest0-21swapper/012:00:580
827699240,24cyclictest1597-21diskmemload09:52:060
827699240,24cyclictest0-21swapper/010:27:240
827699240,24cyclictest0-21swapper/009:17:160
827699240,0cyclictest0-21swapper/009:55:420
8291992323,0cyclictest0-21swapper/312:37:583
8291992323,0cyclictest0-21swapper/312:37:573
8291992323,0cyclictest0-21swapper/312:22:183
8291992323,0cyclictest0-21swapper/312:13:513
8291992323,0cyclictest0-21swapper/310:36:023
8291992323,0cyclictest0-21swapper/310:30:513
8291992323,0cyclictest0-21swapper/308:02:253
8291992322,1cyclictest11215-21ssh09:18:303
8291992321,1cyclictest1597-21diskmemload11:38:003
8291992321,1cyclictest0-21swapper/309:47:413
829199230,2cyclictest4537-21ssh10:15:103
829199230,23cyclictest0-21swapper/312:26:013
829199230,23cyclictest0-21swapper/310:53:493
829199230,22cyclictest10490-21ssh10:57:263
829199230,1cyclictest0-21swapper/309:27:493
829199230,0cyclictest1597-21diskmemload09:51:113
829199230,0cyclictest0-21swapper/310:49:383
829199230,0cyclictest0-21swapper/309:30:293
8287992323,0cyclictest1597-21diskmemload09:20:542
8287992323,0cyclictest0-21swapper/209:48:262
8287992322,1cyclictest1597-21diskmemload12:27:482
8287992321,2cyclictest19634-21rm09:27:112
828799231,21cyclictest29239-21latency_hist09:00:002
828799230,2cyclictest18636-21sendmail-msp11:40:002
828799230,23cyclictest0-21swapper/211:17:392
828799230,23cyclictest0-21swapper/210:15:162
828799230,22cyclictest5120-21cron08:10:012
828799230,22cyclictest14650-21rm12:11:122
828799230,22cyclictest13414-21sh07:20:002
828799230,22cyclictest0-21swapper/212:16:442
828799230,22cyclictest0-21swapper/211:31:462
828799230,0cyclictest1597-21diskmemload09:35:542
828799230,0cyclictest0-21swapper/209:31:242
828799230,0cyclictest0-21swapper/209:15:042
8284992323,0cyclictest0-21swapper/112:02:541
8284992323,0cyclictest0-21swapper/111:50:521
8284992323,0cyclictest0-21swapper/111:17:401
8284992323,0cyclictest0-21swapper/110:07:271
8284992323,0cyclictest0-21swapper/110:01:591
8284992323,0cyclictest0-21swapper/109:55:321
828499230,23cyclictest0-21swapper/112:12:301
828499230,23cyclictest0-21swapper/111:56:501
828499230,23cyclictest0-21swapper/109:14:551
828499230,22cyclictest4210-21sh10:15:001
828499230,22cyclictest1602-21cstates12:32:281
828499230,1cyclictest1597-21diskmemload11:48:471
828499230,1cyclictest13485-21grep10:25:001
828499230,0cyclictest0-21swapper/110:38:511
828499230,0cyclictest0-21swapper/109:48:071
828499230,0cyclictest0-21swapper/109:40:421
828499230,0cyclictest0-21swapper/109:17:291
8276992323,0cyclictest0-21swapper/012:26:010
8276992323,0cyclictest0-21swapper/010:53:490
8276992322,1cyclictest0-21swapper/012:37:570
8276992322,1cyclictest0-21swapper/012:37:570
827699230,2cyclictest12427-21wc08:25:000
827699230,23cyclictest1597-21diskmemload09:47:330
827699230,23cyclictest1597-21diskmemload09:37:300
827699230,23cyclictest0-21swapper/011:09:030
827699230,23cyclictest0-21swapper/010:03:120
827699230,22cyclictest0-21swapper/011:32:320
827699230,22cyclictest0-21swapper/009:20:170
827699230,0cyclictest1597-21diskmemload11:44:240
827699230,0cyclictest1597-21diskmemload11:38:550
827699230,0cyclictest1597-21diskmemload10:37:130
827699230,0cyclictest0-21swapper/012:30:270
827699230,0cyclictest0-21swapper/010:34:140
827699230,0cyclictest0-21swapper/010:05:190
827699230,0cyclictest0-21swapper/009:41:290
827699230,0cyclictest0-21swapper/009:25:160
827699230,0cyclictest0-21swapper/009:11:190
8291992222,0cyclictest0-21swapper/311:41:303
8291992222,0cyclictest0-21swapper/311:33:463
8291992221,1cyclictest1597-21diskmemload12:06:273
8291992220,1cyclictest1597-21diskmemload10:12:113
829199220,22cyclictest0-21swapper/311:48:413
829199220,21cyclictest23136-21grep07:40:003
829199220,21cyclictest22475-21apt-get08:47:253
829199220,21cyclictest0-21swapper/312:34:183
829199220,21cyclictest0-21swapper/311:27:313
829199220,21cyclictest0-21swapper/310:08:293
829199220,21cyclictest0-21swapper/309:22:123
829199220,21cyclictest0-21swapper/308:42:223
829199220,21cyclictest0-21swapper/307:27:253
829199220,1cyclictest0-21swapper/311:20:193
8287992222,0cyclictest0-21swapper/212:20:212
8287992222,0cyclictest0-21swapper/210:35:042
8287992222,0cyclictest0-21swapper/210:23:262
8287992222,0cyclictest0-21swapper/210:14:512
8287992220,1cyclictest308-21munin-run08:00:002
8287992220,1cyclictest0-21swapper/210:42:282
8287992220,1cyclictest0-21swapper/210:30:262
8287992220,1cyclictest0-21swapper/210:07:282
828799220,22cyclictest0-21swapper/211:07:072
828799220,21cyclictest28430-21apt-get07:52:482
828799220,21cyclictest23603-21apt-get07:42:262
828799220,21cyclictest10639-21munin-run07:15:002
828799220,21cyclictest0-21swapper/211:47:292
828799220,21cyclictest0-21swapper/211:26:132
828799220,21cyclictest0-21swapper/210:04:312
828799220,1cyclictest1597-21diskmemload12:08:502
828799220,1cyclictest1314-21apt-get12:32:282
828799220,0cyclictest1597-21diskmemload11:57:242
828799220,0cyclictest0-21swapper/210:27:192
8284992222,0cyclictest0-21swapper/112:35:051
8284992222,0cyclictest0-21swapper/112:35:051
8284992222,0cyclictest0-21swapper/112:08:391
8284992222,0cyclictest0-21swapper/111:12:231
8284992222,0cyclictest0-21swapper/110:46:511
8284992222,0cyclictest0-21swapper/110:29:021
8284992222,0cyclictest0-21swapper/109:50:421
8284992222,0cyclictest0-21swapper/109:31:381
828499220,22cyclictest0-21swapper/110:31:171
828499220,22cyclictest0-21swapper/109:20:481
828499220,22cyclictest0-21swapper/107:52:481
828499220,21cyclictest18689-21apt-get07:32:271
828499220,21cyclictest0-21swapper/111:22:251
828499220,1cyclictest8999-21sh10:55:001
828499220,0cyclictest1597-21diskmemload11:39:011
828499220,0cyclictest0-21swapper/110:56:331
828499220,0cyclictest0-21swapper/110:16:461
8276992222,0cyclictest0-21swapper/012:22:180
8276992222,0cyclictest0-21swapper/012:15:140
8276992222,0cyclictest0-21swapper/011:48:410
8276992222,0cyclictest0-21swapper/008:02:250
8276992221,1cyclictest16281-21apt-get07:27:240
827699220,22cyclictest1597-21diskmemload11:56:320
827699220,22cyclictest1597-21diskmemload11:24:560
827699220,22cyclictest15104-21apt-get11:02:250
827699220,22cyclictest0-21swapper/010:20:050
827699220,21cyclictest5817-21ssh11:26:270
827699220,21cyclictest1597-21diskmemload09:10:000
827699220,21cyclictest0-21swapper/011:13:110
827699220,1cyclictest13748-21ssh12:09:570
827699220,0cyclictest0-21swapper/011:50:350
827699220,0cyclictest0-21swapper/010:46:340
8291992121,0cyclictest0-21swapper/311:55:363
8291992121,0cyclictest0-21swapper/310:42:053
8291992121,0cyclictest0-21swapper/310:02:313
8291992120,1cyclictest1597-21diskmemload11:10:333
8291992119,1cyclictest20653-21idleruntime-cro07:35:003
829199210,21cyclictest0-21swapper/312:00:213
829199210,20cyclictest1597-21diskmemload11:00:393
829199210,1cyclictest0-21swapper/308:27:253
829199210,0cyclictest0-21swapper/311:16:363
829199210,0cyclictest0-21swapper/308:17:273
8287992121,0cyclictest0-21swapper/211:21:092
8287992121,0cyclictest0-21swapper/211:02:092
8287992121,0cyclictest0-21swapper/210:57:252
8287992120,0cyclictest0-21swapper/208:12:252
828799210,21cyclictest0-21swapper/212:36:442
828799210,21cyclictest0-21swapper/212:36:442
828799210,21cyclictest0-21swapper/210:50:042
828799210,20cyclictest10474-21apt-get08:22:292
828799210,1cyclictest8044-21apt-get08:17:262
828799210,0cyclictest1597-21diskmemload11:42:422
8284992121,0cyclictest0-21swapper/107:12:251
8284992120,1cyclictest20187-21ssh11:42:281
8284992119,2cyclictest5557-21/usr/sbin/munin08:12:261
828499210,21cyclictest0-21swapper/112:21:251
828499210,20cyclictest0-21swapper/107:42:251
828499210,0cyclictest3191-21apt-get08:07:231
828499210,0cyclictest1597-21diskmemload11:07:121
828499210,0cyclictest0-21swapper/112:25:201
828499210,0cyclictest0-21swapper/111:28:371
828499210,0cyclictest0-21swapper/111:01:561
828499210,0cyclictest0-21swapper/110:41:261
8276992121,0cyclictest8044-21apt-get08:17:260
8276992117,3cyclictest11246-21apt-get07:15:020
827699210,21cyclictest24441-21perf08:50:000
827699210,21cyclictest0-21swapper/010:40:580
827699210,21cyclictest0-21swapper/010:12:120
827699210,1cyclictest20077-21apt-get08:42:220
827699210,0cyclictest0-21swapper/007:57:290
8291992020,0cyclictest0-21swapper/311:05:323
8291992020,0cyclictest0-21swapper/307:47:253
8291992020,0cyclictest0-21swapper/307:42:263
8287992020,0cyclictest21189-21apt-get07:37:272
828799200,0cyclictest0-21swapper/208:47:252
8284992019,1cyclictest0-21swapper/108:32:271
8276992020,0cyclictest0-21swapper/008:37:240
8276992018,1cyclictest20646-21munin-run07:35:000
827699200,20cyclictest0-21swapper/008:27:250
827699200,0cyclictest25995-21apt-get07:47:250
8291991919,0cyclictest32084-21apt-get09:07:273
8291991918,1cyclictest27268-21apt-get08:57:263
8291991918,0cyclictest0-21swapper/307:12:253
8287991919,0cyclictest0-21swapper/207:32:282
8287991918,1cyclictest0-21swapper/208:02:262
8284991919,0cyclictest30802-21apt-get07:57:291
8284991919,0cyclictest0-21swapper/108:52:251
8284991917,1cyclictest15835-21perf07:24:591
8276991919,0cyclictest0-21swapper/007:42:270
829199180,18cyclictest0-21swapper/308:52:253
8287991818,0cyclictest0-21swapper/208:37:242
8287991815,2cyclictest22047-21munin-run08:45:002
828499180,17cyclictest22006-21cron08:45:001
8276991818,0cyclictest24869-21apt-get08:52:250
8291991716,1cyclictest0-21swapper/308:07:233
8287991715,1cyclictest13883-21apt-get07:22:242
828799170,16cyclictest18640-21systemd-journal08:30:002
8284991717,0cyclictest0-21swapper/109:02:271
8284991717,0cyclictest0-21swapper/107:37:271
8276991717,0cyclictest0-21swapper/008:57:260
829199160,0cyclictest0-21swapper/308:32:263
8287991616,0cyclictest0-21swapper/207:27:242
8284991614,1cyclictest0-21swapper/108:49:031
828499160,15cyclictest0-21swapper/109:10:001
8276991616,0cyclictest0-21swapper/007:12:250
8276991615,1cyclictest0-21swapper/008:07:230
8276991614,1cyclictest0-21swapper/007:52:500
8287991515,0cyclictest0-21swapper/208:52:262
8284991515,0cyclictest773-21apt-get08:02:251
8291991414,0cyclictest0-21swapper/309:00:013
8291991414,0cyclictest0-21swapper/307:51:163
829199140,14cyclictest0-21swapper/308:35:333
829199140,14cyclictest0-21swapper/308:12:243
829199140,0cyclictest0-21swapper/307:55:313
829199140,0cyclictest0-21swapper/307:20:313
8287991414,0cyclictest0-21swapper/207:45:052
828799140,14cyclictest0-21swapper/209:01:092
828799140,14cyclictest0-21swapper/208:30:152
8284991414,0cyclictest0-21swapper/108:35:471
8284991414,0cyclictest0-21swapper/108:21:211
8284991414,0cyclictest0-21swapper/108:15:221
8284991414,0cyclictest0-21swapper/107:25:011
828499140,14cyclictest0-21swapper/108:55:011
828499140,14cyclictest0-21swapper/108:25:021
828499140,14cyclictest0-21swapper/107:45:211
828499140,14cyclictest0-21swapper/107:16:501
8276991414,0cyclictest0-21swapper/009:00:180
827699140,14cyclictest0-21swapper/008:32:110
827699140,14cyclictest0-21swapper/008:10:400
827699140,14cyclictest0-21swapper/007:37:000
827699140,0cyclictest0-21swapper/007:20:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional