You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-25 - 07:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Sat Jan 25, 2025 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6575999428,11cyclictest8150irq/56-dwc_otg_23:04:551
61092890,5sleep0657499cyclictest00:04:190
6574998121,26cyclictest0-21swapper/021:59:510
89922790,5sleep2657699cyclictest20:54:442
113522750,5sleep1657599cyclictest21:54:171
113522750,5sleep1657599cyclictest21:54:171
280452740,5sleep3657799cyclictest21:30:283
657699728,28cyclictest0-21swapper/223:09:502
657499715,42cyclictest9-21ksoftirqd/000:40:130
657499715,42cyclictest9-21ksoftirqd/000:40:130
6574997019,34cyclictest9550irq/48-DMA14:55:080
657599692,9cyclictest5437-21ssh21:44:551
6574996911,38cyclictest0-21swapper/023:54:590
657599683,12cyclictest7950irq/56-dwc_otg20:44:551
657499687,25cyclictest0-21swapper/021:44:580
6575996714,35cyclictest15908-21sh22:45:061
657599668,39cyclictest0-21swapper/123:58:171
137612660,2sleep30-21swapper/322:42:303
6577996527,19cyclictest26230-21/usr/sbin/munin00:34:543
6574996545,4cyclictest25875-21apt-get22:14:510
657499652,12cyclictest0-21swapper/000:24:550
142032650,2sleep10-21swapper/122:43:241
6574996438,5cyclictest0-21swapper/000:34:510
6577996324,28cyclictest30658-21ssh00:40:263
6577996324,28cyclictest30658-21ssh00:40:263
657499637,35cyclictest0-21swapper/020:44:580
6577996233,10cyclictest31389-21apt-get23:54:543
6577996224,23cyclictest4122-21ssh22:28:523
6576996225,3cyclictest7950irq/56-dwc_otg23:19:582
657599629,33cyclictest8150irq/56-dwc_otg_23:41:181
657599626,39cyclictest7950irq/56-dwc_otg23:20:001
657599625,44cyclictest8150irq/56-dwc_otg_21:20:031
657599623,46cyclictest24309-21ssh22:58:241
6574996243,5cyclictest101ktimersoftd/000:05:170
6574996215,31cyclictest11024-21idleruntime-cro22:39:440
6577996122,19cyclictest32311-21fschecks_time20:25:033
6577996122,19cyclictest32311-21fschecks_time20:25:033
6577996121,23cyclictest18965-21ssh23:35:533
6577996121,23cyclictest18965-21ssh23:35:533
657599615,5cyclictest8050irq/56-dwc_otg_23:25:141
657599611,6cyclictest2604-21ssh23:14:251
657599611,4cyclictest7856-21ls00:05:161
6574996112,6cyclictest30644-21switchtime22:20:100
6574996112,6cyclictest30644-21switchtime22:20:100
6577996025,21cyclictest14754-21chrt21:58:343
6577996022,25cyclictest6378-21/usr/sbin/munin21:45:103
657499603,54cyclictest0-21swapper/023:19:580
6577995923,15cyclictest8050irq/56-dwc_otg_00:00:033
657599596,37cyclictest0-21swapper/100:04:451
657599593,46cyclictest32494-21ssh21:36:571
657599591,43cyclictest7950irq/56-dwc_otg21:14:531
6577995827,12cyclictest7259-21cut23:20:023
6577995826,13cyclictest25875-21apt-get22:14:533
6577995823,12cyclictest20261-21cat19:50:113
6577995822,22cyclictest17691-21ssh22:01:373
6577995817,22cyclictest11628-21ntpq23:25:093
657599586,3cyclictest0-21swapper/123:19:111
657599586,35cyclictest7950irq/56-dwc_otg22:14:501
657599583,17cyclictest29689-21ssh22:19:571
657599583,17cyclictest29689-21ssh22:19:571
657599582,8cyclictest8150irq/56-dwc_otg_00:24:021
6575995810,33cyclictest0-21swapper/100:25:171
657499582,19cyclictest0-21swapper/021:24:570
6574995815,25cyclictest14953-21grep19:35:170
6574995815,25cyclictest14953-21grep19:35:170
657499581,11cyclictest11162-21aten_rbpower_cu21:00:010
657499581,11cyclictest11162-21aten_rbpower_cu21:00:010
317342580,2sleep00-21swapper/021:35:200
311822580,1sleep20-21swapper/200:41:442
311822580,1sleep20-21swapper/200:41:442
6577995720,18cyclictest21641-21ssh22:07:023
6577995718,22cyclictest31048-21ssh23:54:393
657599574,34cyclictest0-21swapper/122:52:291
657599574,34cyclictest0-21swapper/122:52:291
657599573,3cyclictest7950irq/56-dwc_otg00:15:011
657599571,8cyclictest19356-21aten_rbpower_po19:49:581
657599571,4cyclictest26420-21rm23:45:251
657499571,36cyclictest13236-21aten_rbpower_vo00:14:550
6574995711,27cyclictest22972-21aten_rbpower_en20:00:000
657799566,12cyclictest15198-21ssh22:44:573
6577995628,11cyclictest26951-21taskset23:46:303
6577995621,20cyclictest10918-21ssh00:10:473
657599567,4cyclictest8150irq/56-dwc_otg_19:30:321
657599566,31cyclictest7950irq/56-dwc_otg23:34:571
657599566,31cyclictest7950irq/56-dwc_otg23:34:571
657599561,3cyclictest8050irq/56-dwc_otg_20:20:011
657499561,29cyclictest11334-21unixbench_multi19:25:140
6577995523,15cyclictest5227-21ssh21:44:453
6577995523,15cyclictest20673-21fschecks_time21:20:013
6577995523,11cyclictest14966-21ssh00:16:253
6577995520,22cyclictest20520-21ssh22:53:183
6577995520,22cyclictest20520-21ssh22:53:183
6577995519,24cyclictest9509-21sh00:08:223
6577995519,20cyclictest23180-21ssh22:09:513
657599551,42cyclictest0-21swapper/100:10:141
657599551,10cyclictest24478-21ssh22:12:361
6574995548,4cyclictest101ktimersoftd/019:44:440
6574995534,4cyclictest0-21swapper/022:54:570
657499552,25cyclictest0-21swapper/021:09:560
6574995515,24cyclictest30057-21cron21:34:450
657499551,37cyclictest25977-21ssh00:34:450
657499551,33cyclictest2962-21latency_hist20:34:440
6577995423,19cyclictest16220-21ssh23:33:083
6577995422,13cyclictest30617-21forks21:34:583
6577995421,20cyclictest5362-21ssh23:17:103
6577995420,26cyclictest22563-21chrt00:27:163
6577995420,23cyclictest1292-21runrttasks00:30:193
6577995417,27cyclictest30876-21rm23:06:253
657599546,4cyclictest8050irq/56-dwc_otg_00:43:081
657599546,4cyclictest8050irq/56-dwc_otg_00:43:081
657599541,4cyclictest7950irq/56-dwc_otg22:25:181
657499543,32cyclictest0-21swapper/023:35:090
657499543,32cyclictest0-21swapper/023:35:090
6574995429,4cyclictest8150irq/56-dwc_otg_23:05:120
657499542,6cyclictest21675-21cat19:55:070
193582540,6sleep0657499cyclictest19:49:580
6577995322,19cyclictest18859-21sshd21:17:123
6577995321,20cyclictest23862-21ssh22:57:273
6577995321,17cyclictest11087-21cut22:39:453
6577995319,24cyclictest2621-21ssh23:14:273
6577995319,16cyclictest24415-21ssh23:44:113
657599535,6cyclictest8150irq/56-dwc_otg_19:24:591
657599535,4cyclictest7950irq/56-dwc_otg20:00:391
657599535,34cyclictest9038-1kworker/u9:222:39:181
657599533,8cyclictest8150irq/56-dwc_otg_21:25:341
657599532,44cyclictest26753-21ls00:35:031
657599532,43cyclictest21530-21sh22:06:481
657599532,3cyclictest0-21swapper/119:35:001
657599532,3cyclictest0-21swapper/119:35:001
657599531,43cyclictest0-21swapper/123:01:271
657599531,42cyclictest8150irq/56-dwc_otg_23:30:341
6574995329,15cyclictest13-21rcuc/023:19:390
6574995329,11cyclictest7950irq/56-dwc_otg23:40:000
657499531,34cyclictest6065-21unixbench_multi20:40:150
657499531,24cyclictest0-21swapper/000:20:100
6574995311,26cyclictest30230-21aten_rbpower_po20:19:590
62562533,44sleep00-21swapper/019:14:090
6577995222,17cyclictest18598-21chrt00:21:323
6577995221,11cyclictest8508-21latency_hist20:49:453
6577995220,12cyclictest28201-21rm23:03:403
657599526,34cyclictest0-21swapper/121:40:401
657599523,36cyclictest8150irq/56-dwc_otg_20:25:061
657599523,36cyclictest8150irq/56-dwc_otg_20:25:061
657599521,9cyclictest29790-21sshd21:34:121
657599521,5cyclictest31032-21ssh23:54:381
6574995230,4cyclictest16459-21grep22:45:120
657499522,31cyclictest19143-21latency_hist19:49:450
6577995124,12cyclictest5465-21ssh22:31:123
6577995121,19cyclictest25497-21ssh21:25:323
6577995117,23cyclictest16314-21diskmemload21:50:203
6577995117,23cyclictest16314-21diskmemload21:50:203
6577995112,27cyclictest21094-21/usr/sbin/munin19:55:153
657599514,40cyclictest8050irq/56-dwc_otg_00:33:101
6575995122,26cyclictest11925-21aten_rbpower_en21:54:541
657599511,5cyclictest22773-21cat19:59:451
657499512,7cyclictest13625-21munin-run19:34:450
657499512,6cyclictest12610-21/usr/sbin/munin21:55:030
657499511,5cyclictest4322-21unixbench_singl20:35:170
6574995114,24cyclictest13-21rcuc/020:55:070
657499511,33cyclictest1292-21runrttasks21:44:210
6577995019,11cyclictest16497-21latency_hist21:14:453
6577995017,23cyclictest10660-21taskset20:58:223
6577995016,16cyclictest8050irq/56-dwc_otg_20:49:473
657599501,9cyclictest2410-21unixbench-2d20:30:111
657599501,8cyclictest17715-21ssh22:01:401
657499508,6cyclictest9550irq/48-DMA14:55:080
6574995040,3cyclictest0-21swapper/021:19:540
6574995026,14cyclictest1292-21runrttasks22:29:310
6577994917,19cyclictest7162-21snmpd20:15:423
6577994917,12cyclictest31022-21ssh22:20:193
6577994917,12cyclictest31022-21ssh22:20:193
6577994916,19cyclictest5519-21missed_timers20:40:083
657699492,11cyclictest0-21swapper/219:19:562
657699491,30cyclictest31-21ksoftirqd/223:54:542
657599493,6cyclictest9550irq/48-DMA14:55:081
657599493,6cyclictest9550irq/48-DMA14:55:081
657599491,8cyclictest9237-21aten_rbpower_cu20:54:541
657599491,8cyclictest8150irq/56-dwc_otg_20:05:001
657599491,7cyclictest27712-21users20:10:111
657599491,7cyclictest16294-21cron21:14:441
6575994911,34cyclictest14548-21latency_hist21:09:441
6575994910,36cyclictest15871-21df19:39:581
657499492,7cyclictest7162-21snmpd23:46:230
657499492,31cyclictest0-21swapper/020:09:440
657499491,31cyclictest8446-21aten_rbpower_cu19:19:580
657499491,27cyclictest0-21swapper/023:24:580
657799482,6cyclictest8150irq/56-dwc_otg_20:09:543
657599489,36cyclictest28815-21kernelversion20:15:091
657599481,7cyclictest8402-21/usr/sbin/munin19:20:091
657599481,7cyclictest6666-21basename19:14:571
657599481,7cyclictest4985-21aten_rbpower_cu20:40:001
657599481,5cyclictest5520-21ssh22:31:201
6574994828,4cyclictest7950irq/56-dwc_otg21:05:000
6577994737,8cyclictest30845-21ntp_states20:20:083
6577994714,24cyclictest0-21swapper/320:33:163
657599475,3cyclictest8050irq/56-dwc_otg_20:52:551
6574994729,6cyclictest8150irq/56-dwc_otg_23:34:450
6574994718,14cyclictest28807-21cut20:15:090
657499471,28cyclictest25527-21/usr/sbin/munin23:00:020
6577994633,10cyclictest8415-21apt-get19:19:563
6577994624,12cyclictest13350-21taskset19:31:283
6577994615,23cyclictest0-21swapper/319:15:113
6577994615,19cyclictest18826-21sshd19:47:113
657699467,24cyclictest0-21swapper/219:29:582
657599462,5cyclictest4309-21sed20:35:171
657599461,6cyclictest19039-21cron19:49:441
6574994638,5cyclictest101ktimersoftd/020:24:590
6574994638,5cyclictest101ktimersoftd/020:24:590
6574994620,13cyclictest0-21swapper/000:11:420
657799453,9cyclictest0-21swapper/319:24:583
6577994536,7cyclictest3153-21apt-get20:35:013
6577994517,17cyclictest25983-21chrt20:06:033
6577994517,15cyclictest24356-21chrt20:03:263
6577994514,9cyclictest0-21swapper/321:03:323
6577994514,9cyclictest0-21swapper/321:03:323
657699457,25cyclictest0-21swapper/222:25:022
6574994524,9cyclictest0-21swapper/022:43:020
657699446,24cyclictest0-21swapper/223:24:582
657699441,4cyclictest7950irq/56-dwc_otg00:24:552
657499442,34cyclictest7318-21kworker/0:121:50:100
657499442,34cyclictest7318-21kworker/0:121:50:100
6574994419,16cyclictest7950irq/56-dwc_otg22:31:090
657499441,26cyclictest0-21swapper/022:51:080
657499441,26cyclictest0-21swapper/022:51:080
657499441,24cyclictest0-21swapper/022:05:140
263152440,3sleep226302-21munin-run20:09:452
6574994216,14cyclictest101ktimersoftd/023:54:350
657499421,27cyclictest723-21ssh23:10:310
657499421,20cyclictest0-21swapper/019:15:290
657799417,23cyclictest0-21swapper/319:39:563
6577994126,12cyclictest14472-21sed19:35:103
6577994126,12cyclictest14472-21sed19:35:103
6577994119,11cyclictest7162-21snmpd21:05:523
657699417,23cyclictest15760-21ssh21:59:582
657699417,22cyclictest0-21swapper/220:29:572
6576994119,4cyclictest1525350wget22:44:582
657499412,19cyclictest26839-21fschecks_time20:09:590
6574994117,15cyclictest0-21swapper/020:51:160
657699408,19cyclictest0-21swapper/223:59:572
657699397,22cyclictest0-21swapper/222:14:502
657699384,6cyclictest1820450rm23:35:052
657699384,6cyclictest1820450rm23:35:052
657699381,23cyclictest7950irq/56-dwc_otg23:09:452
6576993725,8cyclictest8150irq/56-dwc_otg_22:54:522
657699371,26cyclictest12794-21ls21:04:452
657699371,26cyclictest12794-21ls21:04:452
657699368,8cyclictest7766-21unixbench_singl19:15:112
657699368,6cyclictest7950irq/56-dwc_otg21:55:032
657699368,5cyclictest8050irq/56-dwc_otg_22:14:442
657699362,9cyclictest951550sshd00:08:232
657699353,9cyclictest0-21swapper/220:19:572
6576993513,4cyclictest19541-21sort19:50:012
657699351,25cyclictest22946-21ssh22:09:452
657699347,4cyclictest8050irq/56-dwc_otg_20:40:112
657699347,17cyclictest0-21swapper/221:39:112
657699346,18cyclictest9254-21ssh21:49:502
657699346,18cyclictest9254-21ssh21:49:502
657699346,18cyclictest0-21swapper/221:24:582
6576993413,5cyclictest17064-21/usr/sbin/munin21:15:072
657699341,21cyclictest23736-21latency_hist21:24:452
657699336,21cyclictest0-21swapper/220:09:562
657699333,18cyclictest31-21ksoftirqd/221:14:442
657699332,8cyclictest0-21swapper/220:55:042
6576993320,5cyclictest30048-21rm21:34:442
6576993315,5cyclictest29270-21sh23:50:562
6576993315,5cyclictest25934-21latency_hist00:34:452
657699331,21cyclictest2657-21ls21:40:102
657699329,3cyclictest7950irq/56-dwc_otg20:15:062
657699326,14cyclictest0-21swapper/219:54:592
657699324,21cyclictest8050irq/56-dwc_otg_00:35:082
657699324,13cyclictest8150irq/56-dwc_otg_21:45:092
657699323,14cyclictest8050irq/56-dwc_otg_00:19:442
6576993225,5cyclictest425-21cron22:44:442
657699321,3cyclictest8050irq/56-dwc_otg_23:39:572
657699321,25cyclictest8501-21timerandwakeup22:35:072
657699321,21cyclictest3290-21ls23:14:562
657699318,14cyclictest8150irq/56-dwc_otg_19:25:142
657699318,12cyclictest16314-21diskmemload22:30:312
6576993122,6cyclictest8343-21munin-plugin-st20:49:442
657699311,7cyclictest4035-21wc20:35:142
657699311,10cyclictest29651-21/usr/sbin/munin22:20:102
657699311,10cyclictest29651-21/usr/sbin/munin22:20:102
6576993110,10cyclictest0-21swapper/223:44:582
657699306,4cyclictest17049-21latency_hist23:34:452
657699301,5cyclictest19736-21ssh22:51:362
657699301,5cyclictest19736-21ssh22:51:362
657699301,22cyclictest23400-21latency20:00:062
657699298,4cyclictest17204-21if_wlan000:20:032
657699298,12cyclictest0-21swapper/222:59:462
657699296,14cyclictest0-21swapper/221:04:562
657699293,15cyclictest13926-21aten_rbpower_po19:35:032
657699293,15cyclictest13926-21aten_rbpower_po19:35:032
657699292,19cyclictest8050irq/56-dwc_otg_19:40:002
6576992920,6cyclictest17578-21aten_rbpower_vo19:45:032
6576992913,9cyclictest1193-21latency_hist20:29:442
6576992913,9cyclictest1193-21latency_hist20:29:442
657699289,10cyclictest0-21swapper/200:09:572
62132283,15sleep30-21swapper/319:13:353
47432263,15sleep20-21swapper/219:09:502
47422264,15sleep10-21swapper/119:09:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional