You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 04:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Jul 26, 2024 12:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1474699260,25cyclictest637-21sh09:35:383
1473599260,25cyclictest25884-21munin-run10:35:010
1474299250,24cyclictest8044-21diskmemload10:34:112
1474299250,24cyclictest0-21swapper/209:27:292
1473599250,24cyclictest11601-21ssh10:20:030
1474699240,2cyclictest13812-21ssh09:15:373
1474699240,23cyclictest20729-21sh11:36:213
1474699240,23cyclictest0-21swapper/311:25:413
1474699240,23cyclictest0-21swapper/311:25:413
1474699240,23cyclictest0-21swapper/310:05:303
14742992422,1cyclictest0-21swapper/211:05:242
14742992420,4cyclictest0-21swapper/209:21:322
1474299240,23cyclictest8044-21diskmemload11:11:462
1474299240,23cyclictest8044-21diskmemload09:15:252
1474299240,23cyclictest11362-21sh10:53:022
1474299240,23cyclictest0-21swapper/210:27:262
1474299240,23cyclictest0-21swapper/210:12:302
1474299240,1cyclictest0-21swapper/209:38:402
1473899240,24cyclictest0-21swapper/110:21:181
1473899240,0cyclictest8044-21diskmemload09:53:361
1473899240,0cyclictest8044-21diskmemload09:53:361
1473899240,0cyclictest0-21swapper/109:19:581
14735992421,2cyclictest14544-21awk09:50:010
1473599240,24cyclictest0-21swapper/011:26:180
1473599240,24cyclictest0-21swapper/011:26:180
1473599240,24cyclictest0-21swapper/010:04:010
1473599240,24cyclictest0-21swapper/009:20:560
1473599240,23cyclictest8044-21diskmemload10:43:370
1473599240,23cyclictest29791-21ssh11:45:150
1473599240,23cyclictest20307-21rm09:56:200
1473599240,23cyclictest16061-21ssh09:52:210
1473599240,23cyclictest16061-21ssh09:52:210
1473599240,23cyclictest0-21swapper/011:00:450
1473599240,0cyclictest0-21swapper/010:27:240
14746992323,0cyclictest8044-21diskmemload10:30:553
14746992323,0cyclictest0-21swapper/310:39:043
14746992323,0cyclictest0-21swapper/310:00:233
14746992321,1cyclictest0-21swapper/311:00:353
14746992321,1cyclictest0-21swapper/310:52:383
14746992321,1cyclictest0-21swapper/310:47:463
1474699230,23cyclictest0-21swapper/311:17:353
1474699230,22cyclictest8060-21ls09:10:013
1474699230,22cyclictest32476-21sh09:35:003
1474699230,22cyclictest2470-21ssh10:10:513
1474699230,22cyclictest19522-21ssh09:22:123
1474699230,22cyclictest0-21swapper/309:48:083
1474699230,1cyclictest0-21swapper/311:41:553
1474699230,0cyclictest8044-21diskmemload11:08:073
1474699230,0cyclictest0-21swapper/309:43:253
1474699230,0cyclictest0-21swapper/309:25:173
1474699230,0cyclictest0-21swapper/309:12:363
14742992323,0cyclictest0-21swapper/211:41:472
14742992321,1cyclictest0-21swapper/210:00:012
14742992321,1cyclictest0-21swapper/207:15:012
1474299230,2cyclictest30005-21sh10:05:432
1474299230,2cyclictest23280-21sh09:58:292
1474299230,22cyclictest861-21perf08:55:012
1474299230,22cyclictest30126-21sh09:32:392
1474299230,1cyclictest8044-21diskmemload09:11:192
1474299230,1cyclictest0-21swapper/211:16:362
1474299230,0cyclictest0-21swapper/211:45:542
1474299230,0cyclictest0-21swapper/209:51:352
1474299230,0cyclictest0-21swapper/209:51:352
14738992323,0cyclictest0-21swapper/111:35:481
14738992323,0cyclictest0-21swapper/111:31:121
14738992323,0cyclictest0-21swapper/111:22:451
14738992323,0cyclictest0-21swapper/110:37:521
14738992323,0cyclictest0-21swapper/109:36:341
14738992323,0cyclictest0-21swapper/109:32:101
14738992321,2cyclictest10942-21rm09:46:481
14738992321,1cyclictest0-21swapper/111:07:061
14738992321,1cyclictest0-21swapper/110:34:171
1473899230,23cyclictest0-21swapper/109:43:281
1473899230,22cyclictest8521-21ssh09:10:251
1473899230,22cyclictest8044-21diskmemload10:49:371
1473899230,22cyclictest7232-21ssh10:15:501
1473899230,22cyclictest23211-21ssh09:58:191
1473899230,22cyclictest20663-21ssh10:29:401
1473899230,22cyclictest14664-21sh11:29:311
1473899230,22cyclictest14664-21sh11:29:311
1473899230,22cyclictest0-21swapper/111:43:261
1473899230,0cyclictest0-21swapper/111:14:581
1473899230,0cyclictest0-21swapper/110:05:551
1473899230,0cyclictest0-21swapper/109:25:151
14735992323,0cyclictest0-21swapper/011:30:080
14735992323,0cyclictest0-21swapper/010:38:220
14735992322,1cyclictest0-21swapper/010:09:420
14735992321,1cyclictest9762-21apt-get09:12:360
14735992321,1cyclictest0-21swapper/011:55:000
1473599230,2cyclictest5877-21ssh09:41:180
1473599230,23cyclictest0-21swapper/009:25:270
1473599230,22cyclictest2182-21sh10:10:220
1473599230,22cyclictest13740-21diskmemload10:56:500
1473599230,22cyclictest1035-21ssh11:16:140
1473599230,1cyclictest6555-21sh11:22:280
1473599230,0cyclictest8044-21diskmemload11:38:280
14746992221,1cyclictest0-21swapper/311:45:473
14746992220,1cyclictest30868-21cron08:50:003
14746992220,1cyclictest0-21swapper/311:11:513
1474699220,2cyclictest13485-21sh10:56:233
1474699220,21cyclictest9652-21apt-get12:07:343
1474699220,21cyclictest8044-21diskmemload11:20:423
1474699220,21cyclictest29649-21perf07:40:013
1474699220,21cyclictest0-21swapper/311:31:043
1474699220,21cyclictest0-21swapper/310:25:203
1474699220,21cyclictest0-21swapper/310:20:313
1474699220,21cyclictest0-21swapper/310:16:593
1474699220,21cyclictest0-21swapper/309:56:093
1474699220,21cyclictest0-21swapper/309:52:353
1474699220,21cyclictest0-21swapper/309:52:353
1474699220,1cyclictest0-21swapper/310:42:373
1474699220,1cyclictest0-21swapper/307:25:023
14742992222,0cyclictest0-21swapper/211:36:222
14742992222,0cyclictest0-21swapper/209:43:342
14742992221,1cyclictest8044-21diskmemload10:46:362
14742992219,0cyclictest0-21swapper/211:23:172
1474299220,21cyclictest8044-21diskmemload11:00:042
1474299220,21cyclictest21682-21apt-get08:32:342
1474299220,21cyclictest20044-21apt-get12:27:352
1474299220,21cyclictest13610-21rm10:56:352
1474299220,21cyclictest0-21swapper/211:25:022
1474299220,21cyclictest0-21swapper/211:25:022
1474299220,21cyclictest0-21swapper/209:46:032
1474299220,1cyclictest16401-21cron08:20:012
1474299220,1cyclictest12082-21apt-get08:12:362
1474299220,1cyclictest12077-21sh10:20:552
1474299220,1cyclictest10833-21ssh10:19:112
1474299220,0cyclictest8044-21diskmemload10:35:352
14738992221,1cyclictest8088-21sh10:50:171
14738992220,1cyclictest1003-21sh11:16:111
1473899220,21cyclictest24134-21apt-get08:37:361
1473899220,21cyclictest0-21swapper/110:02:041
1473899220,1cyclictest6541-21ssh10:15:001
1473899220,1cyclictest13590-21ssh10:56:331
1473899220,0cyclictest0-21swapper/111:00:081
14735992222,0cyclictest8044-21diskmemload10:47:150
14735992222,0cyclictest0-21swapper/011:42:260
14735992222,0cyclictest0-21swapper/011:09:390
14735992222,0cyclictest0-21swapper/010:52:440
14735992222,0cyclictest0-21swapper/010:15:500
1473599220,21cyclictest8044-21diskmemload11:12:130
1473599220,21cyclictest29671-21cut07:40:010
1473599220,21cyclictest0-21swapper/012:37:370
1473599220,21cyclictest0-21swapper/009:05:010
1473599220,21cyclictest0-21swapper/009:05:010
1473599220,21cyclictest0-21swapper/008:22:340
1473599220,21cyclictest0-21swapper/007:52:350
1473599220,1cyclictest14674-21ssh09:17:070
1473599220,0cyclictest0-21swapper/009:35:090
14746992121,0cyclictest0-21swapper/311:52:363
14746992119,1cyclictest19596-21wc12:25:013
1474699210,20cyclictest11646-21awk08:10:013
1474699210,20cyclictest0-21swapper/312:27:353
1474699210,20cyclictest0-21swapper/312:02:343
14742992121,0cyclictest0-21swapper/210:40:142
14742992120,1cyclictest3729-21apt-get09:02:342
14742992120,1cyclictest3729-21apt-get09:02:342
14742992119,1cyclictest0-21swapper/207:32:362
1474299211,1cyclictest5473-21head11:57:392
1474299210,21cyclictest0-21swapper/208:47:362
1474299210,20cyclictest0-21swapper/207:27:372
1474299210,1cyclictest19499-21turbostat07:20:012
1474299210,0cyclictest0-21swapper/211:30:122
14738992120,1cyclictest834-21awk08:55:011
1473899210,21cyclictest8044-21diskmemload10:41:341
1473899210,21cyclictest0-21swapper/109:21:541
1473899210,20cyclictest22809-21apt-get07:27:371
1473899210,0cyclictest0-21swapper/111:50:141
14735992121,0cyclictest0-21swapper/007:22:360
14735992121,0cyclictest0-21swapper/007:22:360
14735992120,0cyclictest0-21swapper/012:12:380
14735992119,1cyclictest15157-21apt-get07:12:360
1473599210,21cyclictest0-21swapper/009:30:200
14746992020,0cyclictest0-21swapper/308:32:343
14746992020,0cyclictest0-21swapper/307:12:363
14746992018,1cyclictest299-21systemd-journal08:25:013
14746992018,1cyclictest0-21swapper/308:15:013
1474699200,0cyclictest0-21swapper/308:27:353
1474699200,0cyclictest0-21swapper/307:32:363
14742992020,0cyclictest24891-21apt-get12:37:372
14742992020,0cyclictest0-21swapper/212:07:342
14742992020,0cyclictest0-21swapper/212:02:352
14742992020,0cyclictest0-21swapper/211:50:132
14742992020,0cyclictest0-21swapper/207:57:342
14742992020,0cyclictest0-21swapper/207:42:362
14742992020,0cyclictest0-21swapper/207:22:362
14742992020,0cyclictest0-21swapper/207:22:362
1474299200,0cyclictest0-21swapper/208:27:352
14738992020,0cyclictest19290-21apt-get08:27:351
14738992020,0cyclictest0-21swapper/108:57:351
14738992020,0cyclictest0-21swapper/108:17:351
14738992020,0cyclictest0-21swapper/108:12:351
1473899200,19cyclictest28941-21apt-get08:47:361
1473899200,0cyclictest0-21swapper/108:32:351
14735992020,0cyclictest4879-21apt-get07:57:330
14735992020,0cyclictest4845-21apt-get11:57:350
14735992020,0cyclictest26548-21apt-get08:42:350
14735992020,0cyclictest0-21swapper/012:15:020
14735992018,1cyclictest616-21gdbus12:30:010
14746991919,0cyclictest0-21swapper/307:47:333
1474699190,1cyclictest9210-21cron08:05:003
14742991919,0cyclictest0-21swapper/208:02:372
14742991919,0cyclictest0-21swapper/207:52:352
14738991919,0cyclictest0-21swapper/112:32:351
14738991919,0cyclictest0-21swapper/112:22:361
14738991919,0cyclictest0-21swapper/112:07:341
14738991919,0cyclictest0-21swapper/109:02:341
14738991919,0cyclictest0-21swapper/109:02:341
14738991919,0cyclictest0-21swapper/107:57:331
14738991919,0cyclictest0-21swapper/107:47:331
14738991919,0cyclictest0-21swapper/107:12:361
14738991918,1cyclictest2484-21apt-get07:52:351
1473899190,18cyclictest13979-21apt-get12:15:021
14735991919,0cyclictest0-21swapper/012:32:350
14735991919,0cyclictest0-21swapper/008:07:340
14735991919,0cyclictest0-21swapper/007:47:330
14735991917,1cyclictest32061-21munin-run07:45:000
1473599190,18cyclictest0-21swapper/008:32:340
14746991818,0cyclictest19964-21apt-get07:22:353
14746991818,0cyclictest19964-21apt-get07:22:353
14746991818,0cyclictest0-21swapper/312:15:023
14742991818,0cyclictest0-21swapper/212:32:352
14742991818,0cyclictest0-21swapper/212:20:022
14742991818,0cyclictest0-21swapper/208:07:342
14742991817,0cyclictest27593-21apt-get07:37:352
14738991818,0cyclictest0-21swapper/112:37:371
14738991818,0cyclictest0-21swapper/107:22:351
14738991818,0cyclictest0-21swapper/107:22:351
14738991816,1cyclictest32034-21ls07:45:001
14735991818,0cyclictest7261-21apt-get12:02:350
14735991818,0cyclictest17653-21apt-get12:22:360
14735991817,0cyclictest0-21swapper/008:57:350
14746991717,0cyclictest0-21swapper/312:00:003
14746991717,0cyclictest0-21swapper/308:52:383
14746991716,1cyclictest22496-21apt-get12:32:353
14746991716,1cyclictest14477-21apt-get08:17:353
14746991716,0cyclictest0-21swapper/312:12:383
1474699170,16cyclictest4146-21grep07:52:473
14742991717,0cyclictest0-21swapper/208:42:342
1474299171,15cyclictest6428-21ls09:07:342
14735991717,0cyclictest0-21swapper/008:27:350
14735991714,2cyclictest27129-21sh07:35:010
1473599170,0cyclictest0-21swapper/008:37:360
14746991616,0cyclictest0-21swapper/307:17:343
1474699160,1cyclictest0-21swapper/308:45:013
14742991616,0cyclictest0-21swapper/212:15:022
14742991616,0cyclictest0-21swapper/208:37:352
14742991616,0cyclictest0-21swapper/208:22:332
14742991615,1cyclictest32501-21apt-get07:47:332
14738991616,0cyclictest0-21swapper/112:27:351
14738991616,0cyclictest0-21swapper/112:12:381
14738991616,0cyclictest0-21swapper/108:07:341
14738991614,1cyclictest0-21swapper/109:10:011
1473899160,14cyclictest580-21irqbalance08:42:581
14735991616,0cyclictest0-21swapper/008:17:350
14735991616,0cyclictest0-21swapper/007:17:340
14735991614,1cyclictest0-21swapper/007:30:010
1473599160,15cyclictest11569-21cron12:10:010
1473599160,14cyclictest0-21swapper/009:05:170
14746991515,0cyclictest0-21swapper/308:37:363
1474699150,7cyclictest0-21swapper/312:37:373
1474699150,1cyclictest6555-21sed07:57:483
1474699150,14cyclictest0-21swapper/307:40:433
14738991515,0cyclictest0-21swapper/107:17:341
14738991513,1cyclictest18850-21perf08:25:011
14746991414,0cyclictest0-21swapper/309:01:083
14746991414,0cyclictest0-21swapper/309:01:083
1474699140,0cyclictest0-21swapper/308:55:033
14742991414,0cyclictest0-21swapper/208:55:472
1474299140,0cyclictest0-21swapper/212:10:562
1473899140,14cyclictest0-21swapper/111:55:021
1473899140,0cyclictest0-21swapper/112:00:091
1473899140,0cyclictest0-21swapper/107:31:061
14735991414,0cyclictest0-21swapper/008:46:190
14735991414,0cyclictest0-21swapper/008:00:340
1473599140,14cyclictest0-21swapper/008:50:180
1473599140,0cyclictest0-21swapper/008:10:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional