You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-13 - 21:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Sun Oct 13, 2024 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2448621030,2sleep20-21swapper/210:28:212
148102960,6sleep22503799cyclictest09:29:072
123382900,2sleep337-21rcuc/309:24:573
251522860,5sleep12503699cyclictest10:29:041
2503599801,62cyclictest0-21swapper/011:06:520
303492750,2sleep00-21swapper/009:50:430
2503599741,64cyclictest0-21swapper/010:04:010
2503599741,64cyclictest0-21swapper/010:04:010
25035997216,43cyclictest0-21swapper/011:29:020
2503799702,52cyclictest27665-21ssh11:14:102
25035996933,22cyclictest0-21swapper/011:34:130
2503799687,39cyclictest8050irq/56-dwc_otg_11:59:112
2503799684,44cyclictest21518-21apt-get09:39:022
2503799683,56cyclictest27992-21ssh12:37:252
2503799682,55cyclictest19175-21/usr/sbin/munin11:04:142
2503599681,64cyclictest13067-21wc08:09:090
2503599681,48cyclictest0-21swapper/012:15:060
2503599681,44cyclictest10528-21ls08:03:490
2503599681,43cyclictest0-21swapper/010:39:280
2503599681,20cyclictest0-21swapper/012:34:060
2503799671,52cyclictest28265-21taskset08:49:532
2503599676,23cyclictest0-21swapper/010:19:030
2503799662,49cyclictest7950irq/56-dwc_otg07:40:172
2503799662,49cyclictest7950irq/56-dwc_otg07:40:172
2503599661,54cyclictest2160-21ssh12:04:090
2503799652,55cyclictest27314-21ssh10:31:212
25037996518,43cyclictest425-21cron11:33:492
25037996516,36cyclictest20086-21sh09:36:152
25035996525,22cyclictest7950irq/56-dwc_otg07:29:180
2503599651,50cyclictest3816-21ssh09:14:030
2503599651,50cyclictest3816-21ssh09:14:030
2503599651,49cyclictest0-21swapper/008:28:000
25035996513,34cyclictest0-21swapper/012:03:240
2503799641,46cyclictest2869-21ssh12:04:182
2503799641,38cyclictest7950irq/56-dwc_otg09:09:012
2503599641,52cyclictest0-21swapper/010:09:100
2503599641,47cyclictest13568-21rm09:27:510
2503799634,40cyclictest25546-21fschecks_time08:44:072
2503799631,44cyclictest25843-21/usr/sbin/munin09:44:132
25035996328,14cyclictest8050irq/56-dwc_otg_09:47:120
2503599632,27cyclictest0-21swapper/010:44:010
2503599631,59cyclictest0-21swapper/010:56:570
2503599631,50cyclictest0-21swapper/011:15:030
2503599631,50cyclictest0-21swapper/010:33:580
2503599631,50cyclictest0-21swapper/010:33:580
2503599631,48cyclictest0-21swapper/011:45:030
2503599631,47cyclictest0-21swapper/011:39:550
2503599631,47cyclictest0-21swapper/011:09:550
2503599631,47cyclictest0-21swapper/011:09:550
2503599631,45cyclictest0-21swapper/010:28:270
25035996314,36cyclictest0-21swapper/009:30:590
25035996311,40cyclictest0-21swapper/011:20:500
2503899625,7cyclictest0-21swapper/308:04:003
25035996226,20cyclictest8150irq/56-dwc_otg_10:33:500
2503599621,51cyclictest0-21swapper/010:14:390
2503599621,45cyclictest8908-21latency_hist07:58:500
247332620,2sleep121-21rcuc/111:51:411
2503599612,48cyclictest6979-21sh12:09:370
2503599611,45cyclictest5152-21ssh10:00:530
2503799602,42cyclictest0-21swapper/211:25:382
2503799602,39cyclictest8150irq/56-dwc_otg_08:39:022
2503799602,36cyclictest1349-21grep10:39:182
2503799601,48cyclictest0-21swapper/210:59:072
25037996010,19cyclictest7950irq/56-dwc_otg10:44:032
2503699607,27cyclictest0-21swapper/107:44:021
2503599601,56cyclictest4664-21seq11:25:590
2503599601,41cyclictest0-21swapper/008:44:000
2503599601,40cyclictest0-21swapper/008:35:490
2503799594,37cyclictest7950irq/56-dwc_otg12:24:062
2503799592,40cyclictest13974-21grep10:14:072
2503799591,4cyclictest8150irq/56-dwc_otg_12:12:292
2503799591,4cyclictest28836-21apt-get10:34:002
2503799591,4cyclictest28836-21apt-get10:34:002
2503799591,45cyclictest0-21swapper/210:06:242
2503799591,45cyclictest0-21swapper/210:06:242
2503599592,43cyclictest0-21swapper/008:57:260
25035995922,22cyclictest8150irq/56-dwc_otg_12:39:070
25035995917,40cyclictest0-21swapper/010:58:590
2503599591,43cyclictest0-21swapper/010:50:270
2503599591,42cyclictest3145-21taskset09:11:160
25035995911,38cyclictest0-21swapper/009:21:310
2503799587,29cyclictest8050irq/56-dwc_otg_11:34:162
2503799583,39cyclictest21083-21sh12:28:502
2503799581,40cyclictest22570-21grep11:49:082
2503599589,38cyclictest0-21swapper/012:28:300
2503599581,47cyclictest0-21swapper/012:23:160
2503599581,47cyclictest0-21swapper/012:23:160
2503599581,47cyclictest0-21swapper/009:39:150
2503599581,46cyclictest0-21swapper/012:31:270
2503599581,46cyclictest0-21swapper/007:40:100
2503599581,46cyclictest0-21swapper/007:40:100
2503599581,44cyclictest25533-21ssh11:53:160
2503599581,43cyclictest2486-21ssh09:58:060
2503799574,30cyclictest28382-21ssh11:56:062
2503799571,5cyclictest8150irq/56-dwc_otg_10:56:032
2503799571,43cyclictest4311-21memory09:14:102
2503799571,43cyclictest4311-21memory09:14:102
2503799571,3cyclictest0-21swapper/207:19:062
2503699574,5cyclictest8150irq/56-dwc_otg_11:24:021
2503699573,8cyclictest7950irq/56-dwc_otg10:49:031
2503699572,5cyclictest8050irq/56-dwc_otg_09:59:011
25035995738,4cyclictest5707-21ls07:49:070
2503599571,9cyclictest0-21swapper/011:58:410
2503799563,39cyclictest0-21swapper/211:12:392
2503799563,39cyclictest0-21swapper/211:12:392
2503799561,40cyclictest7950irq/56-dwc_otg08:09:172
2503599561,40cyclictest11330-21/usr/sbin/munin08:04:100
195322560,4sleep119524-21fschecks_time11:04:061
2503899552,10cyclictest8150irq/56-dwc_otg_10:54:003
2503699553,11cyclictest0-21swapper/108:54:001
25036995529,18cyclictest8150irq/56-dwc_otg_10:34:021
25036995529,18cyclictest8150irq/56-dwc_otg_10:34:021
2503599556,22cyclictest0-21swapper/007:19:010
2503599551,40cyclictest0-21swapper/008:17:050
2503599551,34cyclictest0-21swapper/007:23:510
2503599551,30cyclictest13-21rcuc/007:34:170
2503599551,30cyclictest13-21rcuc/007:34:170
2503799543,40cyclictest8150irq/56-dwc_otg_10:50:552
2503799541,4cyclictest29050-21apt-get12:39:032
2503799541,44cyclictest0-21swapper/209:25:352
2503799541,41cyclictest16691-21sh12:23:232
2503799541,41cyclictest16691-21sh12:23:232
2503799541,2cyclictest0-21swapper/209:19:142
25035995419,21cyclictest31804-21grep08:59:180
25035995419,21cyclictest20504-21sh09:37:140
2503599541,42cyclictest0-21swapper/008:20:030
2503599541,36cyclictest0-21swapper/009:05:450
25035995412,9cyclictest0-21swapper/007:14:010
2503799533,42cyclictest12151-21ssh10:11:012
2503799531,5cyclictest32009-21apt-get09:54:032
2503799531,49cyclictest29895-21unixbench-2d08:54:172
2503799531,41cyclictest31814-21latency_hist09:53:502
2503799531,3cyclictest8150irq/56-dwc_otg_08:04:172
2503799531,38cyclictest31916-21chrt09:00:252
25036995315,24cyclictest0-21swapper/110:44:031
2503799524,35cyclictest8150irq/56-dwc_otg_12:14:122
2503799522,47cyclictest18313-21ssh11:43:582
2503799522,36cyclictest0-21swapper/207:45:272
2503799522,35cyclictest0-21swapper/210:20:372
2503799521,4cyclictest8150irq/56-dwc_otg_09:59:032
2503799521,37cyclictest0-21swapper/211:19:582
2503799521,2cyclictest0-21swapper/207:13:502
2503699522,8cyclictest0-21swapper/107:29:021
2503599521,37cyclictest0-21swapper/008:33:250
2503599521,37cyclictest0-21swapper/008:33:250
2503599521,36cyclictest0-21swapper/008:41:160
25035995210,30cyclictest0-21swapper/007:45:440
25038995124,19cyclictest39-21ksoftirqd/311:38:593
25035995110,22cyclictest28198-21unixbench_singl08:49:180
246702513,41sleep00-21swapper/007:12:360
2503899502,12cyclictest0-21swapper/310:49:013
2503799502,45cyclictest7241-21aten_rbpower_po07:54:032
2503799502,37cyclictest0-21swapper/211:39:412
2503799501,5cyclictest131-21systemd-journal08:32:022
2503799501,5cyclictest131-21systemd-journal08:32:022
2503799501,33cyclictest0-21swapper/208:27:462
2503899493,8cyclictest8150irq/56-dwc_otg_10:24:023
2503799491,45cyclictest31542-21timerandwakeup07:29:182
2503799491,45cyclictest28902-21grep07:24:052
2503899487,25cyclictest0-21swapper/308:09:033
2503799481,44cyclictest16207-21cut08:19:022
2503799481,43cyclictest21675-21grep08:34:022
2503799481,42cyclictest0-21swapper/207:49:012
2503799472,42cyclictest32426-21/usr/sbin/munin09:04:142
2503799471,43cyclictest14447-21aten_rbpower_po08:14:062
2503899467,26cyclictest0-21swapper/312:19:033
2503899467,26cyclictest0-21swapper/312:19:033
2503899467,25cyclictest0-21swapper/307:34:023
2503899467,25cyclictest0-21swapper/307:34:023
2503899467,24cyclictest0-21swapper/311:54:033
2503799461,4cyclictest32649-21fschecks_count07:34:062
2503799461,4cyclictest32649-21fschecks_count07:34:062
2503899457,24cyclictest0-21swapper/308:49:033
2503899457,23cyclictest0-21swapper/307:49:023
2503799451,4cyclictest9271-21tune2fs07:59:312
2503699456,17cyclictest8050irq/56-dwc_otg_11:29:171
2503899448,25cyclictest32648-21rm10:39:033
2503899447,23cyclictest0-21swapper/311:14:023
25038994421,4cyclictest3181-21aten_rbpower_cu09:59:033
2503899437,25cyclictest0-21swapper/311:49:043
2503899427,23cyclictest0-21swapper/308:19:023
2503899427,23cyclictest0-21swapper/307:54:023
2503899423,12cyclictest18212-21kworker/3:211:04:013
2503699423,31cyclictest8150irq/56-dwc_otg_12:14:011
25036994211,21cyclictest32020-21ssh09:54:031
272602410,2sleep30-21swapper/312:35:593
2503899411,7cyclictest1752-21taskset07:39:003
2503899411,7cyclictest1752-21taskset07:39:003
2503699414,10cyclictest8050irq/56-dwc_otg_11:44:001
25036994115,16cyclictest15179-21runrttasks09:29:131
2503899402,7cyclictest7950irq/56-dwc_otg12:04:003
2503699409,15cyclictest8150irq/56-dwc_otg_09:39:071
25036994011,16cyclictest19924-21wget08:29:031
25036994011,16cyclictest19924-21wget08:29:031
2398724024,7sleep20-21swapper/207:09:222
25038993915,10cyclictest26210-21unixbench_singl07:14:183
25038993914,5cyclictest20097-21sort08:29:053
25038993914,5cyclictest20097-21sort08:29:053
25038993910,5cyclictest39-21ksoftirqd/309:44:153
25036993924,5cyclictest170550wget12:04:041
25036993919,4cyclictest18225-21df09:34:061
2503899385,20cyclictest10234-21ssh10:09:023
2503899381,26cyclictest22101-21ls11:48:503
2503899381,24cyclictest0-21swapper/312:24:043
25038993811,3cyclictest7950irq/56-dwc_otg11:59:003
2503699381,4cyclictest26171-21ssh11:54:021
192342380,4sleep319226-21ssh09:34:193
2503899378,16cyclictest8150irq/56-dwc_otg_09:28:503
2503699377,22cyclictest0-21swapper/111:34:031
2503699372,5cyclictest0-21swapper/109:24:021
25036993718,5cyclictest1884-21cpu07:39:181
25036993718,5cyclictest1884-21cpu07:39:181
2503699371,22cyclictest32199-21latency_hist09:03:501
25036993710,24cyclictest0-21swapper/109:49:021
2503899367,6cyclictest8050irq/56-dwc_otg_10:19:013
2503899361,26cyclictest0-21swapper/307:59:023
2503899361,24cyclictest21937-21cut08:34:063
2503899361,14cyclictest0-21swapper/311:11:113
2503899361,14cyclictest0-21swapper/311:11:113
2503699369,16cyclictest8150irq/56-dwc_otg_12:39:181
2503699368,5cyclictest7950irq/56-dwc_otg11:14:091
2503699368,15cyclictest8150irq/56-dwc_otg_12:19:081
2503699368,15cyclictest8150irq/56-dwc_otg_12:19:081
2503699366,8cyclictest7950irq/56-dwc_otg11:09:141
2503699366,8cyclictest7950irq/56-dwc_otg11:09:141
2503699365,6cyclictest1304-21latency_hist12:03:491
25036993616,7cyclictest0-21swapper/110:14:051
25036993612,4cyclictest0-21swapper/110:04:061
25036993612,4cyclictest0-21swapper/110:04:061
2503699361,20cyclictest4463-21ntp_states09:14:121
2503699361,20cyclictest4463-21ntp_states09:14:121
2503699361,11cyclictest0-21swapper/108:04:011
234342368,15sleep10-21swapper/107:09:091
2503899354,4cyclictest0-21swapper/311:34:003
2503899353,17cyclictest9313-21latency_hist12:13:503
25038993517,10cyclictest2488-21/usr/sbin/munin11:24:093
2503699357,6cyclictest7950irq/56-dwc_otg12:30:111
2503699354,11cyclictest18513-21unixbench_singl12:24:191
25036993514,6cyclictest18266-21fschecks_count08:24:071
25036993513,3cyclictest0-21swapper/109:43:581
25036993510,5cyclictest23-21ksoftirqd/108:39:081
274162340,2sleep10-21swapper/107:19:091
2503899342,12cyclictest8050irq/56-dwc_otg_09:04:173
2503699343,6cyclictest22344-21/usr/sbin/munin10:24:171
2503699341,6cyclictest7950irq/56-dwc_otg08:14:071
2503699341,6cyclictest18656-21tail10:19:181
2503899336,12cyclictest8150irq/56-dwc_otg_12:29:073
2503899335,7cyclictest7950irq/56-dwc_otg10:33:503
2503899334,4cyclictest0-21swapper/310:14:023
25038993326,5cyclictest6920-21idleruntime-cro09:18:503
25038993326,5cyclictest6920-21idleruntime-cro09:18:503
2503899332,14cyclictest8150irq/56-dwc_otg_10:44:043
2503899331,2cyclictest0-21swapper/307:19:013
2503899331,18cyclictest19573-21latency_hist08:28:503
25038993310,5cyclictest0-21swapper/311:19:103
2503699334,5cyclictest6745-21unixbench_multi12:09:181
2503699334,4cyclictest8150irq/56-dwc_otg_07:23:551
2503699332,6cyclictest7950irq/56-dwc_otg10:13:491
25036993312,5cyclictest15592-21unixbench-2d11:39:171
2503899325,4cyclictest8150irq/56-dwc_otg_10:34:103
2503899325,4cyclictest8150irq/56-dwc_otg_10:34:103
2503899324,15cyclictest8150irq/56-dwc_otg_08:59:573
2503899322,14cyclictest8150irq/56-dwc_otg_10:04:043
2503899322,14cyclictest8150irq/56-dwc_otg_10:04:043
25038993216,6cyclictest3527-21/usr/sbin/munin07:44:063
2503899321,20cyclictest0-21swapper/307:33:503
2503699327,15cyclictest0-21swapper/110:59:021
2503699326,6cyclictest8050irq/56-dwc_otg_08:49:081
2503699323,5cyclictest3369-21cron09:13:491
2503699321,6cyclictest31112-21/usr/sbin/munin11:19:041
2503699321,3cyclictest0-21swapper/108:22:001
25036993212,10cyclictest25912-21ssh12:34:141
2503699321,20cyclictest9095-21ssh09:20:411
2503699321,19cyclictest14138-21latency_hist08:13:501
2503899318,4cyclictest0-21swapper/312:43:183
2503899318,12cyclictest8150irq/56-dwc_otg_08:14:203
2503899318,10cyclictest8150irq/56-dwc_otg_09:49:103
2503899313,16cyclictest8150irq/56-dwc_otg_11:30:313
2503899311,5cyclictest8050irq/56-dwc_otg_09:54:073
2503899311,18cyclictest0-21swapper/309:39:033
2503699317,3cyclictest7950irq/56-dwc_otg07:54:001
2503699316,6cyclictest8050irq/56-dwc_otg_07:34:091
2503699316,6cyclictest8050irq/56-dwc_otg_07:34:091
2503699314,4cyclictest7950irq/56-dwc_otg10:39:151
2503699312,5cyclictest8050irq/56-dwc_otg_07:49:171
2503699311,10cyclictest15086-21ssh10:58:501
2503699310,22cyclictest0-21swapper/109:04:181
2503899309,4cyclictest0-21swapper/312:14:023
2503899306,14cyclictest0-21swapper/309:19:043
2503899302,19cyclictest0-21swapper/310:59:033
2503899301,7cyclictest28849-21aten_rbpower_en07:24:053
2503699307,5cyclictest8150irq/56-dwc_otg_07:14:101
2503699302,4cyclictest8990-21aten_rbpower_cu07:59:021
2503899296,12cyclictest8150irq/56-dwc_otg_08:54:133
2503899291,13cyclictest8150irq/56-dwc_otg_08:44:133
25036992918,7cyclictest22711-21unixbench_multi08:34:161
2503899285,4cyclictest8150irq/56-dwc_otg_08:39:213
2503899274,4cyclictest8150irq/56-dwc_otg_09:10:233
2503699274,4cyclictest0-21swapper/108:44:011
232702275,9sleep30-21swapper/307:09:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional