You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 19:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Thu Apr 25, 2024 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8339992922,1cyclictest0-21swapper/012:02:430
833999270,0cyclictest0-21swapper/012:16:350
835199260,2cyclictest13070-21ssh09:52:143
834499260,25cyclictest0-21swapper/109:13:571
8351992523,1cyclictest1710-21diskmemload12:13:253
8339992523,1cyclictest549-21munin-run09:40:000
833999250,25cyclictest0-21swapper/011:44:530
8351992423,1cyclictest1710-21diskmemload09:37:223
835199240,24cyclictest0-21swapper/310:17:333
835199240,23cyclictest18330-21sh09:26:093
835199240,1cyclictest20998-21ntp_states11:42:453
835199240,1cyclictest1710-21diskmemload11:45:103
835199240,0cyclictest1710-21diskmemload09:21:503
834699240,3cyclictest32528-21apt-get10:12:382
834699240,24cyclictest0-21swapper/210:00:042
834699240,23cyclictest1710-21diskmemload12:17:052
834699240,23cyclictest1710-21diskmemload11:02:592
834699240,23cyclictest1710-21diskmemload10:34:362
834699240,23cyclictest0-21swapper/212:26:102
834699240,23cyclictest0-21swapper/211:31:542
834699240,23cyclictest0-21swapper/208:35:002
834699240,1cyclictest1710-21diskmemload09:18:272
8344992424,0cyclictest0-21swapper/109:30:031
834499240,23cyclictest18258-21ssh09:57:101
834499240,23cyclictest0-21swapper/111:25:211
834499240,0cyclictest29417-21apt-get09:02:381
8339992424,0cyclictest0-21swapper/010:03:030
8339992423,1cyclictest0-21swapper/011:39:170
8339992423,1cyclictest0-21swapper/011:28:010
8339992421,2cyclictest0-21swapper/009:51:020
833999240,23cyclictest597-21dbus-daemon10:20:010
833999240,23cyclictest27161-21sh11:49:170
833999240,23cyclictest18380-21sh09:26:130
833999240,23cyclictest1710-21diskmemload10:51:290
833999240,23cyclictest0-21swapper/011:56:120
833999240,23cyclictest0-21swapper/009:57:080
833999240,23cyclictest0-21swapper/009:41:420
8351992323,0cyclictest0-21swapper/311:36:253
8351992323,0cyclictest0-21swapper/311:27:183
8351992323,0cyclictest0-21swapper/311:23:053
8351992323,0cyclictest0-21swapper/311:16:443
8351992321,1cyclictest32455-21ls08:00:003
8351992320,2cyclictest2787-21rm09:11:173
835199230,23cyclictest1710-21diskmemload10:27:073
835199230,23cyclictest0-21swapper/311:51:383
835199230,23cyclictest0-21swapper/310:35:163
835199230,23cyclictest0-21swapper/309:45:153
835199230,23cyclictest0-21swapper/309:16:203
835199230,22cyclictest3583-21ssh09:42:463
835199230,22cyclictest3437-21apt10:50:003
835199230,22cyclictest24597-21rm12:22:053
835199230,22cyclictest19136-21rm12:15:373
835199230,22cyclictest1054-21sh12:31:153
835199230,1cyclictest27020-21kworker/u8:010:07:383
8346992323,0cyclictest1710-21diskmemload09:34:202
8346992323,0cyclictest0-21swapper/212:11:042
8346992323,0cyclictest0-21swapper/209:55:542
8346992322,1cyclictest0-21swapper/209:14:032
8346992321,1cyclictest7841-21ssh09:47:222
8346992321,1cyclictest0-21swapper/209:21:032
8346992320,2cyclictest5690-21idleruntime-cro09:45:002
834699230,23cyclictest0-21swapper/211:39:172
834699230,23cyclictest0-21swapper/210:07:222
834699230,22cyclictest28250-21ssh11:50:492
834699230,22cyclictest21697-21ssh11:09:122
834699230,22cyclictest0-21swapper/209:36:052
834699230,0cyclictest0-21swapper/210:47:182
834699230,0cyclictest0-21swapper/210:21:032
834699230,0cyclictest0-21swapper/209:50:232
8344992323,0cyclictest1710-21diskmemload10:30:181
8344992323,0cyclictest0-21swapper/112:39:331
8344992323,0cyclictest0-21swapper/112:10:191
8344992323,0cyclictest0-21swapper/111:53:231
8344992323,0cyclictest0-21swapper/110:49:131
8344992321,1cyclictest0-21swapper/110:59:431
8344992321,1cyclictest0-21swapper/109:44:581
8344992320,2cyclictest6788-21rm10:18:081
8344992320,2cyclictest17961-21dump-pmu-power07:30:001
834499230,2cyclictest9178-21latency_hist12:05:001
834499230,23cyclictest1710-21diskmemload10:50:031
834499230,23cyclictest0-21swapper/111:20:461
834499230,23cyclictest0-21swapper/110:00:081
834499230,22cyclictest32632-21sh11:55:161
834499230,22cyclictest26897-21sh10:05:471
834499230,22cyclictest14159-21ssh11:02:051
834499230,22cyclictest12505-21rm09:20:071
834499230,22cyclictest11782-21rm09:50:151
834499230,22cyclictest0-21swapper/110:37:461
834499230,22cyclictest0-21swapper/109:27:181
834499230,0cyclictest0-21swapper/112:19:291
834499230,0cyclictest0-21swapper/111:07:441
834499230,0cyclictest0-21swapper/109:46:091
834499230,0cyclictest0-21swapper/109:36:051
8339992323,0cyclictest0-21swapper/012:06:170
8339992322,1cyclictest0-21swapper/011:51:540
8339992321,1cyclictest22796-21ssh09:30:040
8339992321,1cyclictest0-21swapper/012:24:510
8339992321,1cyclictest0-21swapper/010:30:500
8339992321,1cyclictest0-21swapper/009:24:460
833999230,2cyclictest7109-21gltestperf12:37:430
833999230,2cyclictest31497-21sh10:10:430
833999230,23cyclictest1710-21diskmemload10:49:260
833999230,23cyclictest0-21swapper/012:31:090
833999230,23cyclictest0-21swapper/010:27:040
833999230,22cyclictest3554-21ssh11:24:420
833999230,22cyclictest2252-21rm09:10:270
833999230,22cyclictest0-21swapper/012:26:200
833999230,0cyclictest1710-21diskmemload10:39:180
833999230,0cyclictest1710-21diskmemload09:46:130
8351992222,0cyclictest1710-21diskmemload10:33:213
8351992222,0cyclictest1710-21diskmemload10:04:203
8351992222,0cyclictest0-21swapper/310:56:553
8351992220,1cyclictest25263-21turbostat.cron07:45:003
8351992220,1cyclictest0-21swapper/310:52:413
835199220,22cyclictest0-21swapper/309:57:003
835199220,22cyclictest0-21swapper/309:30:553
835199220,21cyclictest9071-21sh12:04:493
835199220,21cyclictest18548-21ssh11:06:343
835199220,21cyclictest14101-21ssh11:01:593
835199220,21cyclictest13618-21apt-get07:22:383
835199220,21cyclictest0-21swapper/310:20:333
835199220,1cyclictest28292-21cpuspeed_turbos10:42:393
835199220,1cyclictest1091-21rm11:56:553
835199220,0cyclictest0-21swapper/312:07:253
8346992222,0cyclictest1710-21diskmemload11:42:292
8346992222,0cyclictest0-21swapper/212:30:362
8346992222,0cyclictest0-21swapper/212:23:522
8346992222,0cyclictest0-21swapper/210:25:422
8346992222,0cyclictest0-21swapper/210:15:592
8346992222,0cyclictest0-21swapper/209:25:462
8346992221,1cyclictest1710-21diskmemload12:09:092
8346992221,1cyclictest1710-21diskmemload10:58:242
8346992220,1cyclictest1739-21perf09:10:002
8346992219,2cyclictest9207-21idleruntime-cro12:04:592
834699220,22cyclictest0-21swapper/211:45:302
834699220,21cyclictest1710-21diskmemload10:40:242
834699220,21cyclictest0-21swapper/207:32:382
834699220,1cyclictest4780-21ssh11:26:312
834699220,1cyclictest28129-21apt-get07:52:372
834699220,1cyclictest0-21swapper/211:57:032
834699220,0cyclictest0-21swapper/211:11:472
8344992220,1cyclictest15568-21wc07:25:001
834499220,22cyclictest0-21swapper/111:44:471
834499220,21cyclictest8749-21apt-get07:12:361
834499220,21cyclictest27167-21rm11:15:131
834499220,21cyclictest13411-21ssh10:26:121
834499220,21cyclictest0-21swapper/111:30:001
834499220,21cyclictest0-21swapper/111:11:311
834499220,21cyclictest0-21swapper/110:20:301
834499220,1cyclictest0-21swapper/112:06:411
834499220,1cyclictest0-21swapper/111:45:021
834499220,1cyclictest0-21swapper/109:19:021
8339992222,0cyclictest0-21swapper/011:10:380
8339992221,1cyclictest0-21swapper/007:52:380
8339992220,1cyclictest28960-21idleruntime-cro09:00:000
8339992220,1cyclictest12138-21munin-plugin-st08:25:000
833999220,22cyclictest0-21swapper/011:15:080
833999220,21cyclictest21444-21rm11:08:430
833999220,21cyclictest1710-21diskmemload11:30:000
833999220,21cyclictest0-21swapper/011:04:130
833999220,21cyclictest0-21swapper/009:15:110
833999220,21cyclictest0-21swapper/007:35:000
833999220,1cyclictest0-21swapper/007:27:400
833999220,0cyclictest1710-21diskmemload10:21:580
833999220,0cyclictest0-21swapper/012:10:240
833999220,0cyclictest0-21swapper/010:40:250
8351992121,0cyclictest0-21swapper/312:36:103
8351992121,0cyclictest0-21swapper/312:25:353
8351992121,0cyclictest0-21swapper/311:30:243
8351992120,1cyclictest0-21swapper/308:27:383
8351992120,0cyclictest0-21swapper/307:47:383
8351992119,1cyclictest14994-21apt-get08:32:393
835199210,21cyclictest0-21swapper/310:10:093
835199210,20cyclictest0-21swapper/308:22:383
835199210,1cyclictest31359-21perf09:05:003
8346992121,0cyclictest481-21apt-get08:02:392
8346992121,0cyclictest0-21swapper/208:27:382
8346992120,0cyclictest0-21swapper/207:20:002
834699210,21cyclictest0-21swapper/211:20:532
834699210,21cyclictest0-21swapper/211:15:322
834699210,21cyclictest0-21swapper/210:37:332
834699210,20cyclictest19807-21apt-get08:42:362
834699210,20cyclictest16018-21apt-get07:27:412
834699210,20cyclictest0-21swapper/208:37:372
834699210,20cyclictest0-21swapper/208:22:392
834699210,0cyclictest0-21swapper/208:57:402
8344992121,0cyclictest0-21swapper/112:30:441
8344992121,0cyclictest0-21swapper/110:40:271
8344992121,0cyclictest0-21swapper/108:02:391
8344992120,1cyclictest24595-21apt-get08:52:361
8344992120,0cyclictest20810-21apt-get07:37:351
834499210,21cyclictest0-21swapper/110:10:091
834499210,0cyclictest11205-21apt-get07:17:411
834499210,0cyclictest0-21swapper/109:07:381
8339992121,0cyclictest62150irq/126-eno110:55:060
8339992120,0cyclictest31974-21apt-get09:05:010
8339992119,1cyclictest2459-21turbostat08:05:000
833999210,21cyclictest0-21swapper/010:08:140
833999210,1cyclictest597-21dbus-daemon07:25:000
833999210,0cyclictest0-21swapper/008:52:360
835199200,0cyclictest0-21swapper/308:17:373
835199200,0cyclictest0-21swapper/308:07:383
8346992020,0cyclictest0-21swapper/207:12:362
8346992019,1cyclictest25727-21apt-get07:47:372
834699200,0cyclictest0-21swapper/210:50:022
8344992020,0cyclictest0-21swapper/108:22:381
834499200,20cyclictest0-21swapper/107:42:371
8339992020,0cyclictest0-21swapper/008:17:370
8339992020,0cyclictest0-21swapper/008:07:380
8339992020,0cyclictest0-21swapper/007:12:370
8339992018,1cyclictest13144-21idleruntime-cro07:20:000
8346991919,0cyclictest0-21swapper/208:52:362
8346991919,0cyclictest0-21swapper/207:37:352
8344991919,0cyclictest0-21swapper/108:17:371
8344991919,0cyclictest0-21swapper/107:52:371
834499190,18cyclictest32462-21sh08:00:001
8351991818,0cyclictest0-21swapper/308:57:393
8351991818,0cyclictest0-21swapper/308:02:383
8351991817,0cyclictest0-21swapper/307:12:363
8351991815,2cyclictest13146-21perf07:20:003
8346991818,0cyclictest0-21swapper/207:57:382
8344991818,0cyclictest0-21swapper/108:27:381
8344991816,1cyclictest21746-21perf08:45:001
8339991818,0cyclictest12592-21apt-get08:27:380
8339991818,0cyclictest0-21swapper/008:47:410
8339991818,0cyclictest0-21swapper/008:32:390
8339991817,1cyclictest0-21swapper/007:50:000
8339991816,1cyclictest19341-21ls08:40:010
8351991717,0cyclictest22211-21apt-get08:47:423
8351991717,0cyclictest0-21swapper/307:32:383
8344991717,0cyclictest0-21swapper/108:57:391
8339991717,0cyclictest23333-21apt-get07:42:370
8339991717,0cyclictest0-21swapper/007:57:380
8339991715,1cyclictest7233-21cron08:15:000
8351991616,0cyclictest0-21swapper/308:52:363
8351991616,0cyclictest0-21swapper/308:37:373
8351991616,0cyclictest0-21swapper/307:52:373
834699160,15cyclictest9041-21wc08:17:472
8344991616,0cyclictest0-21swapper/108:32:391
8344991615,0cyclictest2926-21apt-get08:07:381
8344991614,1cyclictest5324-21apt-get08:12:401
8339991616,0cyclictest0-21swapper/008:42:350
8339991616,0cyclictest0-21swapper/007:37:340
8351991513,1cyclictest7270-21grep08:15:003
8346991515,0cyclictest0-21swapper/208:12:402
8339991515,0cyclictest0-21swapper/009:02:370
835199140,14cyclictest0-21swapper/308:40:353
835199140,0cyclictest0-21swapper/309:05:303
835199140,0cyclictest0-21swapper/307:36:573
835199140,0cyclictest0-21swapper/307:25:253
8346991414,0cyclictest0-21swapper/208:05:512
8346991414,0cyclictest0-21swapper/207:40:022
834699140,14cyclictest0-21swapper/208:45:152
834699140,14cyclictest0-21swapper/207:20:262
834699140,0cyclictest0-21swapper/209:00:282
834499140,14cyclictest0-21swapper/108:35:081
834499140,14cyclictest0-21swapper/107:45:251
834499140,14cyclictest0-21swapper/107:30:181
834499140,0cyclictest0-21swapper/108:45:461
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional