You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-29 - 19:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Thu Feb 29, 2024 12:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
247072980,4sleep324710-21unixbench_singl09:02:293
1592499987,26cyclictest0-21swapper/111:51:551
109672960,2sleep30-21swapper/309:37:233
222662940,2sleep00-21swapper/011:36:190
1592199881,66cyclictest7474-21fschecks_count08:17:150
72472850,4sleep37236-21ssh10:22:273
1592199841,64cyclictest4562-21ssh09:27:110
233852810,6sleep01592199cyclictest09:57:240
1592199813,57cyclictest0-21swapper/011:11:490
1592199801,60cyclictest7536-21aten_rbpower_cu12:02:090
15921997917,5cyclictest22804-21unixbench-2d08:57:250
1592199781,63cyclictest0-21swapper/010:04:560
15921997720,43cyclictest8150irq/56-dwc_otg_08:22:340
15921997715,46cyclictest16140-21diskstats10:37:140
1592199751,58cyclictest12126-21unixbench_multi12:07:260
59562740,2sleep21592599cyclictest10:21:502
1592699731,56cyclictest20622-21/usr/sbin/munin08:52:193
1592199734,56cyclictest0-21swapper/010:17:210
1592199734,56cyclictest0-21swapper/010:17:210
1592199731,4cyclictest16915-21ssh11:27:200
15921997310,47cyclictest21782-21missed_timers12:22:230
15921997219,4cyclictest1219-21/usr/sbin/munin11:52:200
1592199721,59cyclictest6349-21modprobe11:11:490
15921997117,39cyclictest0-21swapper/009:19:030
1592199701,20cyclictest10506-21netstat11:17:270
1592199701,19cyclictest0-21swapper/009:32:520
1592499691,35cyclictest0-21swapper/110:47:161
1592199692,19cyclictest0-21swapper/007:28:030
325742680,2sleep30-21swapper/311:02:163
1592699681,55cyclictest21559-21runrttasks10:45:333
1592199688,50cyclictest9-21ksoftirqd/008:37:260
15921996812,12cyclictest0-21swapper/011:22:280
15921996812,12cyclictest0-21swapper/011:22:280
1592199681,16cyclictest20673-21wc08:52:200
1592699671,56cyclictest22595-21sed08:57:233
15921996715,39cyclictest0-21swapper/009:24:290
20982660,3sleep22100-21rm11:52:592
1592699663,48cyclictest1224-21ssh12:39:323
1592699662,52cyclictest29322-21ssh12:32:473
15925996611,6cyclictest8150irq/56-dwc_otg_11:17:142
15921996621,38cyclictest0-21swapper/010:41:580
15921996612,8cyclictest0-21swapper/010:22:170
1592199661,19cyclictest0-21swapper/012:35:560
1592199661,16cyclictest12610-21ssh10:32:110
1592699651,44cyclictest14130-21taskset08:35:423
1592599657,7cyclictest7950irq/56-dwc_otg12:07:262
1592599655,4cyclictest8050irq/56-dwc_otg_09:27:162
1592199655,14cyclictest0-21swapper/012:38:170
1592199652,19cyclictest0-21swapper/012:17:130
15921996518,3cyclictest0-21swapper/012:29:070
15921996515,4cyclictest8050irq/56-dwc_otg_09:51:500
15921996512,5cyclictest17354-21rm12:16:370
1592199651,19cyclictest0-21swapper/009:13:560
1592199651,15cyclictest0-21swapper/009:51:490
1592699643,50cyclictest14808-21runrttasks09:43:443
1592699643,50cyclictest14808-21runrttasks09:43:443
1592699641,45cyclictest68552sh09:31:483
1592199648,13cyclictest0-21swapper/011:57:590
1592199643,57cyclictest32505-21rm11:51:340
1592199641,13cyclictest0-21swapper/011:40:260
1592599635,7cyclictest0-21swapper/208:52:242
1592199631,54cyclictest32247-21latency_hist07:56:490
1592199631,4cyclictest8150irq/56-dwc_otg_11:02:230
1592199631,16cyclictest0-21swapper/010:47:290
1592699622,44cyclictest8150irq/56-dwc_otg_11:12:143
1592699621,44cyclictest3075-21fschecks_count10:17:153
1592699621,44cyclictest3075-21fschecks_count10:17:153
15921996219,34cyclictest0-21swapper/010:53:140
1592199621,16cyclictest5841-21if_eth008:12:150
1592699615,41cyclictest8150irq/56-dwc_otg_11:51:543
1592699611,50cyclictest7452-21/usr/sbin/munin08:17:133
1592699611,49cyclictest12193-21sed12:07:263
1592699611,45cyclictest0-21swapper/312:31:153
1592699611,45cyclictest0-21swapper/310:50:523
1592699611,44cyclictest17973-21cut08:46:493
1592699611,42cyclictest0-21swapper/307:33:233
15921996116,3cyclictest0-21swapper/007:48:590
15921996115,34cyclictest0-21swapper/009:40:260
15921996114,9cyclictest846-21sh10:13:020
15921996114,9cyclictest846-21sh10:13:020
1592199611,45cyclictest0-21swapper/010:57:040
15921996114,39cyclictest0-21swapper/009:46:080
15921996114,39cyclictest0-21swapper/009:46:080
1592199611,34cyclictest21294-21latency_hist07:26:490
1592199611,17cyclictest0-21swapper/011:43:590
1592199611,15cyclictest0-21swapper/010:07:370
1592699601,49cyclictest28167-21sh11:44:033
1592699601,48cyclictest19065-21cat09:51:483
1592699601,47cyclictest7489-21apt-get12:02:093
1592699601,46cyclictest28301-21ssh10:56:043
1592699601,42cyclictest12412-21ssh10:31:503
1592599608,4cyclictest8050irq/56-dwc_otg_12:02:132
1592199601,17cyclictest0-21swapper/010:29:100
1592699591,47cyclictest131-21systemd-journal11:41:213
1592699591,47cyclictest10678-21ssh11:17:313
1592699591,46cyclictest13883-21ntp_states11:22:263
1592699591,46cyclictest13883-21ntp_states11:22:263
1592699591,45cyclictest30088-21sh10:07:573
1592699591,43cyclictest16982-21ssh12:15:413
1592699591,42cyclictest0-21swapper/311:49:153
1592699591,42cyclictest0-21swapper/308:38:263
1592699591,41cyclictest0-21swapper/307:38:273
15925995910,3cyclictest0-21swapper/210:15:082
15925995910,3cyclictest0-21swapper/210:15:082
1592199592,45cyclictest0-21swapper/009:05:300
1592199591,19cyclictest0-21swapper/008:46:330
1592199591,17cyclictest12305-21chrt08:30:300
1592199591,17cyclictest0-21swapper/007:33:210
1592699583,43cyclictest22648-21cut09:57:123
1592699581,5cyclictest20529-21ssh12:21:153
1592699581,47cyclictest32349-21rm09:19:013
1592699581,44cyclictest3101-21ssh09:24:273
1592699581,43cyclictest16123-21df10:37:133
1592599582,14cyclictest31-21ksoftirqd/209:24:492
1592499585,18cyclictest8050irq/56-dwc_otg_09:42:091
1592499585,18cyclictest8050irq/56-dwc_otg_09:42:091
1592199585,5cyclictest14248-21idleruntime-cro08:36:480
1592199582,18cyclictest0-21swapper/008:09:340
15921995814,22cyclictest32758-21fschecks_time07:57:180
1592699573,41cyclictest8625-21rm09:32:593
1592699572,44cyclictest31266-21ssh11:00:103
1592699571,46cyclictest973-21taskset10:13:203
1592699571,46cyclictest973-21taskset10:13:203
1592699571,45cyclictest0-21swapper/311:07:163
1592699568,38cyclictest6664-21snmpd07:45:583
15926995615,31cyclictest5783-21idleruntime08:12:153
1592699561,46cyclictest9345-21ssh10:26:503
1592699561,42cyclictest3919-21ssh11:56:513
1592699561,41cyclictest23788-21ssh12:25:573
1592599566,8cyclictest8050irq/56-dwc_otg_10:22:082
1592199569,15cyclictest0-21swapper/008:04:180
1592199562,14cyclictest0-21swapper/008:46:540
1592699553,48cyclictest19501-21ssh11:32:123
1592699551,43cyclictest1320-21chrt07:59:103
1592699551,41cyclictest0-21swapper/310:05:153
1592699551,40cyclictest0-21swapper/311:28:053
1592699551,39cyclictest29042-21ssh09:13:563
1592199545,4cyclictest26215-21grep07:37:450
15921995412,9cyclictest19244-21chrt07:20:510
1592199541,15cyclictest0-21swapper/007:13:400
1592699531,40cyclictest18973-21apt-get09:51:503
1592699531,38cyclictest21087-21taskset07:26:073
1592499537,34cyclictest0-21swapper/107:46:551
1592199531,7cyclictest28120-21unixbench_singl07:42:310
1592699521,44cyclictest0-21swapper/308:46:523
1592699521,38cyclictest6664-21snmpd08:30:443
1592499527,30cyclictest0-21swapper/110:07:101
1592499526,28cyclictest17837-21ssh12:17:111
1592199521,13cyclictest0-21swapper/009:07:150
1592199521,13cyclictest0-21swapper/009:07:150
1592699512,39cyclictest8150irq/56-dwc_otg_07:15:523
1592699511,39cyclictest10251-21uptime08:22:323
1592599514,28cyclictest8150irq/56-dwc_otg_07:36:492
1592699501,4cyclictest0-21swapper/307:53:433
1592499507,5cyclictest0-21swapper/108:02:091
1592499507,14cyclictest0-21swapper/110:52:101
1592499498,15cyclictest7274-21aten_rbpower_cu08:17:111
15924994936,5cyclictest8050irq/56-dwc_otg_11:11:481
1592699481,44cyclictest22664-21taskset07:28:153
1592699481,36cyclictest3110-21taskset08:03:573
1592499488,25cyclictest0-21swapper/109:02:121
1592699472,42cyclictest3674-21aten_rbpower_en08:07:133
1592699471,42cyclictest25481-21wget09:07:163
1592699471,42cyclictest25481-21wget09:07:163
1592699471,3cyclictest28820-21apt-get07:47:133
1592499479,22cyclictest17066-21unixbench-2d10:37:281
1592499477,25cyclictest0-21swapper/107:36:531
15924994720,4cyclictest21493-21aten_rbpower_po07:27:121
15924994714,8cyclictest7950irq/56-dwc_otg12:02:061
15924994710,24cyclictest16961-21rm12:15:391
155762472,36sleep00-21swapper/007:10:490
155762472,36sleep00-21swapper/007:10:490
1592599464,15cyclictest6664-21snmpd09:02:102
1592499467,26cyclictest0-21swapper/109:17:151
1592499466,25cyclictest0-21swapper/111:02:101
1592499462,5cyclictest8050irq/56-dwc_otg_11:32:111
15924994614,13cyclictest8150irq/56-dwc_otg_10:42:321
15924994612,16cyclictest22853-21ssh12:23:351
1592699451,41cyclictest17975-21df07:17:143
1592599456,9cyclictest21523-21ls12:22:192
1592499457,24cyclictest0-21swapper/109:47:111
1592499457,23cyclictest0-21swapper/112:27:111
1592499457,23cyclictest0-21swapper/109:07:141
1592499457,23cyclictest0-21swapper/109:07:141
1592499455,24cyclictest2692-21ssh10:16:561
1592499455,24cyclictest2692-21ssh10:16:561
1592499453,20cyclictest2447-21latency_hist12:41:491
15924994527,9cyclictest8050irq/56-dwc_otg_09:51:501
15924994517,20cyclictest22553-21apt-get09:57:081
1592499448,25cyclictest0-21swapper/108:47:081
1592499447,24cyclictest0-21swapper/111:27:111
15924994410,15cyclictest8150irq/56-dwc_otg_11:17:251
131862440,4sleep229-21rcuc/209:42:092
131862440,4sleep229-21rcuc/209:42:092
1592499438,5cyclictest13471-21fschecks_time11:22:181
1592499438,5cyclictest13471-21fschecks_time11:22:181
1592499437,26cyclictest0-21swapper/111:47:131
1592499432,9cyclictest0-21swapper/110:02:081
15924994322,9cyclictest8150irq/56-dwc_otg_10:32:121
15924994317,10cyclictest7950irq/56-dwc_otg10:31:481
15924994315,5cyclictest7950irq/56-dwc_otg12:07:231
1592599422,11cyclictest7950irq/56-dwc_otg10:47:142
1592499429,13cyclictest11727-21ssh09:38:191
1592499427,25cyclictest0-21swapper/111:57:091
1592499427,21cyclictest25254-21ssh11:40:111
15924994217,4cyclictest8150irq/56-dwc_otg_08:22:311
15924994214,11cyclictest7950irq/56-dwc_otg09:27:071
15924994125,3cyclictest0-21swapper/108:30:501
15924994116,10cyclictest8150irq/56-dwc_otg_11:14:261
15924994112,13cyclictest8150irq/56-dwc_otg_09:16:161
1592499407,23cyclictest0-21swapper/108:12:101
15924994014,12cyclictest221ktimersoftd/108:57:151
281182390,3sleep2301ktimersoftd/209:12:262
1592499398,16cyclictest8589-21ssh09:32:521
1592499394,12cyclictest26913-21diskmemload10:57:241
15924993925,4cyclictest8150irq/56-dwc_otg_11:43:571
15924993921,8cyclictest29871-21ssh12:34:041
15925993821,4cyclictest31049-21ssh11:47:592
1592499386,12cyclictest5347-21sed08:11:491
15924993822,8cyclictest8150irq/56-dwc_otg_09:22:321
15924993819,9cyclictest7950irq/56-dwc_otg10:23:401
15924993811,10cyclictest221ktimersoftd/108:52:141
1592599373,4cyclictest8150irq/56-dwc_otg_07:22:122
15925993713,11cyclictest17447-21modprobe12:16:492
1592499372,20cyclictest8050irq/56-dwc_otg_08:37:201
1592499371,27cyclictest19412-21ls07:21:481
15924993712,12cyclictest8050irq/56-dwc_otg_08:35:451
1592599367,4cyclictest8050irq/56-dwc_otg_10:17:242
1592599364,7cyclictest8150irq/56-dwc_otg_11:07:092
15925993623,6cyclictest301ktimersoftd/207:59:562
1592599361,10cyclictest22897-21head08:57:262
1592499367,14cyclictest0-21swapper/107:32:111
1592499365,4cyclictest17082-1kworker/1:2H07:41:551
1592499363,22cyclictest17876-21awk08:46:481
15924993610,11cyclictest823-21ssh10:12:581
15924993610,11cyclictest823-21ssh10:12:581
66242350,3sleep26611-21ssh11:12:182
1592599358,13cyclictest8150irq/56-dwc_otg_10:01:482
15924993525,4cyclictest8050irq/56-dwc_otg_08:00:371
1592599341,21cyclictest25253-21ls07:37:132
154842342,23sleep10-21swapper/107:09:371
154842342,23sleep10-21swapper/107:09:371
310552330,1sleep20-21swapper/209:17:252
1592599335,12cyclictest8150irq/56-dwc_otg_08:02:312
1592599333,9cyclictest0-21swapper/211:42:092
1592599333,10cyclictest0-21swapper/210:42:082
1592599331,19cyclictest8150irq/56-dwc_otg_07:42:252
15925993311,5cyclictest28185-21sh10:55:462
15925993310,5cyclictest727250wget08:17:112
15925993310,4cyclictest9662-21missed_timers08:22:252
1592599324,5cyclictest0-21swapper/209:34:392
15925993222,6cyclictest32283-21rm11:02:082
1592599321,6cyclictest13754-21grep08:32:282
15925993213,5cyclictest1292-21runrttasks12:20:312
15925993213,11cyclictest13479-21fschecks_time11:22:182
15925993213,11cyclictest13479-21fschecks_time11:22:182
1592599321,17cyclictest26049-21ssh11:41:492
1592599321,11cyclictest8050irq/56-dwc_otg_07:21:032
1592499325,14cyclictest8150irq/56-dwc_otg_07:12:351
1592499322,2cyclictest0-21swapper/107:52:081
1592499321,23cyclictest20191-21missed_timers07:22:181
276512310,1sleep20-21swapper/210:05:232
161122310,3sleep216113-21hostname09:47:122
1592599314,13cyclictest0-21swapper/208:07:122
1592599313,14cyclictest8050irq/56-dwc_otg_09:52:192
15925993117,4cyclictest21375-21sh11:34:012
1592599311,5cyclictest13149-21ssh10:32:192
1592599309,6cyclictest29-21rcuc/212:32:142
1592599308,4cyclictest8050irq/56-dwc_otg_10:27:252
1592599307,6cyclictest8050irq/56-dwc_otg_11:27:192
1592599307,5cyclictest8150irq/56-dwc_otg_12:37:102
1592599307,4cyclictest7950irq/56-dwc_otg10:37:242
1592599307,10cyclictest8050irq/56-dwc_otg_07:47:302
1592599306,10cyclictest0-21swapper/211:00:582
1592599304,5cyclictest8050irq/56-dwc_otg_10:11:492
1592599304,12cyclictest8150irq/56-dwc_otg_09:10:522
1592599304,12cyclictest8150irq/56-dwc_otg_09:10:522
1592599304,10cyclictest8050irq/56-dwc_otg_12:27:092
1592599294,22cyclictest10868-21runrttasks08:27:082
1592599294,12cyclictest0-21swapper/209:41:352
1592599293,13cyclictest8150irq/56-dwc_otg_08:47:122
1592599291,14cyclictest8050irq/56-dwc_otg_11:57:292
1592599291,12cyclictest8050irq/56-dwc_otg_08:42:182
154962293,20sleep30-21swapper/307:09:473
154962293,20sleep30-21swapper/307:09:473
160312280,2sleep216032-21cron08:41:482
1592599284,6cyclictest7950irq/56-dwc_otg07:52:182
1592599283,10cyclictest6001-21missed_timers08:12:192
156252284,15sleep20-21swapper/207:11:282
156252284,15sleep20-21swapper/207:11:282
1592599271,4cyclictest16096-21aten_rbpower_vo07:12:272
1592599271,13cyclictest0-21swapper/207:27:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional