You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-10-14 - 03:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Mon Oct 14, 2024 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30102910,1sleep20-21swapper/223:13:502
255342910,2sleep225520-21ssh21:33:502
255342910,2sleep225520-21ssh21:33:502
32215999019,53cyclictest9-21ksoftirqd/000:19:000
3221899817,54cyclictest0-21swapper/320:39:043
3221899817,54cyclictest0-21swapper/320:39:043
32215998123,42cyclictest1292-21runrttasks23:39:020
5382790,2sleep00-21swapper/019:14:130
3221599795,42cyclictest18411-21apt-get21:24:010
68622770,5sleep33221899cyclictest23:18:503
292082770,2sleep30-21swapper/300:30:563
165102750,4sleep116490-21ssh22:04:171
152652740,2sleep00-21swapper/000:11:490
3221799732,38cyclictest0-21swapper/222:19:012
3221599727,36cyclictest0-21swapper/021:54:040
3221599716,23cyclictest0-21swapper/000:34:030
32215997110,34cyclictest0-21swapper/019:23:550
107822700,5sleep23221799cyclictest00:05:232
3221599694,31cyclictest0-21swapper/020:44:020
3221599693,41cyclictest0-21swapper/022:48:590
32215996834,4cyclictest0-21swapper/022:14:020
32215996814,9cyclictest0-21swapper/022:19:020
32215996813,11cyclictest0-21swapper/022:24:000
32215996813,11cyclictest0-21swapper/022:24:000
321342660,2sleep10-21swapper/123:09:061
32215996537,4cyclictest0-21swapper/019:28:540
3221599651,40cyclictest0-21swapper/022:54:060
3221599645,15cyclictest31910-21ssh23:09:030
32215996424,4cyclictest0-21swapper/023:44:000
3221599637,38cyclictest8359-21tail19:34:190
32215996345,5cyclictest0-21swapper/021:19:520
3221599628,5cyclictest0-21swapper/021:29:000
3221599628,5cyclictest0-21swapper/021:29:000
3221599615,37cyclictest0-21swapper/021:48:490
3221599613,31cyclictest16024-21idleruntime-cro19:58:500
32215996035,12cyclictest0-21swapper/023:19:260
3221599603,40cyclictest0-21swapper/023:33:060
3221599602,55cyclictest101ktimersoftd/019:23:500
3221599594,38cyclictest0-21swapper/023:08:500
32215995911,29cyclictest5713-21grep21:49:180
32215995911,29cyclictest5713-21grep21:49:180
32215995841,8cyclictest0-21swapper/023:49:490
3221599581,46cyclictest0-21swapper/022:34:090
3221599577,32cyclictest16546-21aten_rbpower_en00:14:040
3221599577,32cyclictest16546-21aten_rbpower_en00:14:040
3221599573,44cyclictest0-21swapper/023:00:150
32215995731,6cyclictest6765-21munin-plugin-st23:18:490
3221599572,37cyclictest0-21swapper/023:24:160
3221599572,31cyclictest18175-21aten_rbpower_vo20:04:050
280702570,2sleep30-21swapper/323:03:533
3221599564,38cyclictest31268-21ssh21:40:380
32215995638,3cyclictest0-21swapper/021:59:140
3221599563,5cyclictest0-21swapper/019:39:010
3221599563,50cyclictest26317-21timerwakeupswit20:24:180
3221599563,42cyclictest0-21swapper/000:41:190
32215995632,7cyclictest101ktimersoftd/000:08:340
140332560,1sleep30-21swapper/322:01:173
3221599555,30cyclictest23472-21acpi20:19:010
32215995510,42cyclictest101ktimersoftd/022:40:570
32215995429,12cyclictest0-21swapper/022:44:050
3221599542,5cyclictest12550-21latency_hist19:48:500
3221599542,43cyclictest0-21swapper/020:29:430
3221599542,30cyclictest31579-21grep20:39:170
3221599542,30cyclictest31579-21grep20:39:170
3221799531,6cyclictest0-21swapper/221:14:022
3221599535,30cyclictest0-21swapper/023:55:180
32215995331,5cyclictest16080-21runrttasks22:04:100
3221599533,10cyclictest0-21swapper/022:09:020
3221599529,5cyclictest8050irq/56-dwc_otg_20:49:030
3221599525,33cyclictest0-21swapper/022:30:210
32215995234,8cyclictest0-21swapper/000:33:090
3221799515,5cyclictest0-21swapper/221:54:042
32216995116,23cyclictest0-21swapper/119:44:031
32215995134,8cyclictest0-21swapper/023:35:490
3221599512,34cyclictest0-21swapper/000:24:170
3221599511,28cyclictest11369-21fschecks_count21:14:070
3221799502,26cyclictest0-21swapper/219:39:012
3221599506,28cyclictest5483-21fschecks_count23:59:070
3221599505,31cyclictest0-21swapper/019:50:190
3221599493,35cyclictest23019-21chrt20:16:200
32215994912,11cyclictest2533150kworker/u9:121:34:100
32215994910,24cyclictest0-21swapper/020:09:030
3221799484,24cyclictest0-21swapper/219:34:032
3221599488,26cyclictest4840-21grep20:54:170
3221599481,30cyclictest0-21swapper/021:04:170
3221899477,25cyclictest0-21swapper/319:49:033
3221699473,3cyclictest0-21swapper/121:18:581
3221599471,35cyclictest0-21swapper/021:02:070
304212474,33sleep00-21swapper/019:09:050
3221799464,10cyclictest0-21swapper/223:49:002
32215994622,4cyclictest8050irq/56-dwc_otg_19:59:180
32215994622,4cyclictest8050irq/56-dwc_otg_19:59:180
51582450,12sleep38150irq/56-dwc_otg_19:28:493
3221899457,24cyclictest0-21swapper/321:28:553
3221899457,24cyclictest0-21swapper/321:28:553
32217994526,5cyclictest19675-21sh00:18:502
32217994526,5cyclictest19675-21sh00:18:502
3221799451,8cyclictest0-21swapper/222:48:592
3221599452,22cyclictest29772-21grep20:34:170
32215994510,16cyclictest10723-21taskset21:13:280
3221899447,25cyclictest0-21swapper/319:44:033
3221899447,23cyclictest0-21swapper/300:24:033
3221799444,12cyclictest19986-21ssh00:19:002
3221699441,35cyclictest8150irq/56-dwc_otg_20:44:021
3221799435,6cyclictest0-21swapper/222:39:032
32217994315,17cyclictest8150irq/56-dwc_otg_22:24:002
32217994315,17cyclictest8150irq/56-dwc_otg_22:24:002
3221699437,24cyclictest0-21swapper/121:44:041
3221799423,10cyclictest26233-21ssh23:44:012
3221799411,8cyclictest7950irq/56-dwc_otg22:59:002
32216994118,11cyclictest16170-21idleruntime-cro00:13:501
3221899402,17cyclictest8050irq/56-dwc_otg_20:44:023
3221799403,9cyclictest0-21swapper/223:24:042
231392400,2sleep30-21swapper/322:56:523
166342400,1sleep30-21swapper/319:59:083
166342400,1sleep30-21swapper/319:59:083
35572390,4sleep229-21rcuc/220:53:492
32218993916,15cyclictest8050irq/56-dwc_otg_21:34:183
3221799397,24cyclictest0-21swapper/223:59:032
32217993932,5cyclictest8150irq/56-dwc_otg_22:09:022
3221799392,9cyclictest0-21swapper/220:44:032
3221799386,22cyclictest0-21swapper/220:09:032
32217993816,12cyclictest1292-21runrttasks22:01:202
3221699384,6cyclictest21233-21grep00:19:181
192082380,4sleep23221799cyclictest20:04:192
3221799379,6cyclictest1910-21unixbench_singl21:44:192
3221799376,22cyclictest22921-21ssh22:14:032
3221799376,21cyclictest0-21swapper/219:59:032
3221799376,21cyclictest0-21swapper/219:59:032
3221799371,9cyclictest5554-21cat21:49:162
3221799371,9cyclictest5554-21cat21:49:162
32217993710,5cyclictest30643-21unixbench_singl21:39:192
3221699372,4cyclictest7950irq/56-dwc_otg20:14:011
32216993717,13cyclictest18754-21/usr/sbin/munin20:04:131
32216993717,10cyclictest25016-21sh22:16:011
3221699371,5cyclictest7950irq/56-dwc_otg22:09:021
3221699371,22cyclictest3184-21latency_hist19:23:501
32218993624,5cyclictest18564-21ssh22:50:023
3221799366,24cyclictest0-21swapper/223:39:032
32217993630,4cyclictest1431-21sh23:54:022
3221799362,14cyclictest8050irq/56-dwc_otg_20:24:192
3221799361,24cyclictest31603-21ls23:08:492
32217993610,13cyclictest0-21swapper/219:58:502
3221699367,4cyclictest8150irq/56-dwc_otg_21:24:071
3221699362,8cyclictest0-21swapper/121:39:041
32216993619,4cyclictest24086-21if_eth000:24:091
3221699361,6cyclictest7902-21ssh21:53:501
3221699361,6cyclictest7902-21ssh21:53:501
32216993612,4cyclictest0-21swapper/123:34:021
32216993612,10cyclictest0-21swapper/123:52:151
271682361,30sleep10-21swapper/100:28:581
3221799356,15cyclictest0-21swapper/219:14:022
3221799355,20cyclictest5526-21ssh22:34:042
32217993529,4cyclictest13630-21sshd19:49:172
32217993513,9cyclictest0-21swapper/220:19:072
3221699357,7cyclictest7950irq/56-dwc_otg21:04:091
3221699351,7cyclictest7950irq/56-dwc_otg21:54:091
32216993510,6cyclictest7950irq/56-dwc_otg23:19:111
14682351,30sleep10-21swapper/100:38:201
3221899345,20cyclictest18611-21ssh23:34:033
3221899345,19cyclictest24399-21ssh22:59:023
3221899342,5cyclictest7431-21aten_rbpower_cu21:04:053
3221899342,11cyclictest18398-21/usr/sbin/munin21:24:153
3221899341,24cyclictest2301-21uniq20:49:083
3221899341,22cyclictest31116-21cut00:34:073
32218993411,12cyclictest0-21swapper/323:49:013
3221799347,4cyclictest8050irq/56-dwc_otg_21:18:592
3221799345,21cyclictest8050irq/56-dwc_otg_00:09:032
3221799343,21cyclictest8150irq/56-dwc_otg_19:19:022
32217993417,5cyclictest20526-21sh23:35:362
3221699346,7cyclictest7950irq/56-dwc_otg20:54:181
3221699345,7cyclictest7950irq/56-dwc_otg19:49:181
3221699344,15cyclictest8050irq/56-dwc_otg_23:29:041
3221699343,7cyclictest0-21swapper/123:24:051
3221699342,16cyclictest12818-21ssh22:43:491
32216993417,9cyclictest24318-21switchtime20:19:161
3221699341,5cyclictest0-21swapper/120:59:031
32216993414,5cyclictest2448150wget22:59:031
3221699341,23cyclictest0-21swapper/121:28:551
3221699341,23cyclictest0-21swapper/121:28:551
32216993411,4cyclictest0-21swapper/122:29:121
317912342,25sleep20-21swapper/219:11:502
277082341,4sleep227808-21ls00:29:112
3221899332,10cyclictest0-21swapper/322:45:323
3221899331,23cyclictest10772-21diskmemload22:24:093
3221899331,23cyclictest10772-21diskmemload22:24:093
32218993310,11cyclictest0-21swapper/321:42:433
3221799339,5cyclictest8050irq/56-dwc_otg_22:54:062
3221799336,8cyclictest8150irq/56-dwc_otg_23:31:182
3221799336,5cyclictest7950irq/56-dwc_otg19:29:002
3221799335,19cyclictest1720-21ssh22:29:032
3221799334,6cyclictest8050irq/56-dwc_otg_22:08:502
3221799334,14cyclictest8150irq/56-dwc_otg_21:34:112
3221799332,22cyclictest8150irq/56-dwc_otg_21:24:582
32217993318,6cyclictest8050irq/56-dwc_otg_00:24:192
32217993317,4cyclictest31-21ksoftirqd/220:18:492
3221699339,4cyclictest0-21swapper/122:45:141
3221699338,14cyclictest0-21swapper/122:38:501
3221699336,11cyclictest8050irq/56-dwc_otg_23:40:191
3221699336,10cyclictest8050irq/56-dwc_otg_21:59:041
3221699332,13cyclictest21-21rcuc/119:24:011
32216993319,4cyclictest28573-21sh23:46:281
32216993316,9cyclictest31519-21sed22:24:161
32216993316,9cyclictest31519-21sed22:24:161
32216993311,6cyclictest27228-21latency22:19:101
3221699331,14cyclictest7950irq/56-dwc_otg22:49:021
32216993310,7cyclictest1956-21ssh00:38:531
3221899329,4cyclictest0-21swapper/321:15:373
3221899329,11cyclictest0-21swapper/323:28:533
3221899327,15cyclictest0-21swapper/319:28:543
3221899326,5cyclictest7950irq/56-dwc_otg20:59:153
3221899326,15cyclictest0-21swapper/321:44:043
3221899325,14cyclictest8050irq/56-dwc_otg_23:09:173
3221899324,5cyclictest7950irq/56-dwc_otg22:39:053
3221899324,20cyclictest5094-21ssh21:49:103
3221899324,20cyclictest5094-21ssh21:49:103
3221899323,13cyclictest8150irq/56-dwc_otg_20:34:043
32218993218,6cyclictest10663-21ssh21:56:513
3221899321,7cyclictest15400-21/usr/sbin/munin21:19:103
32218993215,8cyclictest8182-21ssh22:37:113
3221899321,21cyclictest9461-21uniq21:09:073
3221899321,21cyclictest0-21swapper/323:26:143
3221899321,20cyclictest24604-21unixbench_singl20:19:193
3221899321,13cyclictest28522-21diskmemload22:20:243
3221799324,13cyclictest8150irq/56-dwc_otg_21:04:142
32217993221,4cyclictest8150irq/56-dwc_otg_23:14:082
3221799321,7cyclictest10251-21ssh23:23:062
3221699323,7cyclictest22719-21ssh22:55:591
32216993220,9cyclictest8150irq/56-dwc_otg_21:14:141
32216993217,4cyclictest29127-21/usr/sbin/munin20:34:081
3221699321,21cyclictest0-21swapper/123:56:061
3221699321,20cyclictest30897-21ls20:39:061
3221699321,20cyclictest30897-21ls20:39:061
3221699321,20cyclictest26336-21ssh21:34:111
311332326,11sleep30-21swapper/319:09:163
3221899319,5cyclictest22436-21apt-get23:39:033
3221899319,4cyclictest0-21swapper/323:48:503
3221899317,6cyclictest7950irq/56-dwc_otg23:19:083
3221899317,5cyclictest8050irq/56-dwc_otg_00:43:503
3221899316,7cyclictest0-21swapper/322:07:453
3221899314,6cyclictest8150irq/56-dwc_otg_19:19:183
3221899312,19cyclictest0-21swapper/320:54:013
32218993120,7cyclictest32331-21cut19:14:033
3221899311,6cyclictest0-21swapper/300:05:553
32218993114,4cyclictest8307-21sh00:03:083
3221899311,25cyclictest15337-21ls19:54:153
3221899311,16cyclictest8150irq/56-dwc_otg_19:34:083
32218993111,12cyclictest8150irq/56-dwc_otg_00:19:183
3221799319,13cyclictest8150irq/56-dwc_otg_22:44:072
3221799315,4cyclictest8150irq/56-dwc_otg_20:43:502
3221799315,4cyclictest8150irq/56-dwc_otg_20:43:502
3221799312,13cyclictest8150irq/56-dwc_otg_21:13:502
32217993115,3cyclictest7950irq/56-dwc_otg00:38:502
3221699316,4cyclictest7950irq/56-dwc_otg23:04:051
3221699314,6cyclictest0-21swapper/120:09:091
3221699313,14cyclictest8050irq/56-dwc_otg_21:09:031
3221699311,7cyclictest540-21grep19:14:131
3221899308,4cyclictest0-21swapper/300:09:053
3221899303,8cyclictest7950irq/56-dwc_otg23:54:073
32218993011,3cyclictest0-21swapper/322:16:593
3221799303,6cyclictest6754-21grep20:59:182
3221799302,6cyclictest8050irq/56-dwc_otg_00:39:042
32217993022,6cyclictest425-21cron19:28:492
3221799301,4cyclictest7950irq/56-dwc_otg19:44:062
3221699309,11cyclictest0-21swapper/100:14:121
3221699309,11cyclictest0-21swapper/100:14:121
3221699306,5cyclictest7950irq/56-dwc_otg23:14:151
3221699303,6cyclictest7950irq/56-dwc_otg23:59:081
3221699301,9cyclictest8956-21awk00:04:011
3221699301,3cyclictest7950irq/56-dwc_otg19:34:061
3221899297,6cyclictest8150irq/56-dwc_otg_19:39:043
3221899297,5cyclictest7950irq/56-dwc_otg22:29:113
3221899297,4cyclictest8050irq/56-dwc_otg_00:14:203
3221899297,4cyclictest8050irq/56-dwc_otg_00:14:203
3221899297,14cyclictest0-21swapper/320:14:023
3221899295,11cyclictest8150irq/56-dwc_otg_20:04:123
3221799294,5cyclictest8150irq/56-dwc_otg_20:29:082
3221699297,9cyclictest16251-21/usr/sbin/munin19:59:111
3221699297,9cyclictest16251-21/usr/sbin/munin19:59:111
3221699295,4cyclictest8150irq/56-dwc_otg_20:49:101
3221699295,12cyclictest0-21swapper/119:39:171
32216992913,9cyclictest25553-21fschecks_count20:24:071
3221699291,17cyclictest0-21swapper/119:54:151
3221899282,6cyclictest20587-21chrt22:09:303
3221899282,17cyclictest0-21swapper/320:30:513
3221699284,4cyclictest8150irq/56-dwc_otg_19:28:551
3221899272,13cyclictest0-21swapper/320:24:053
3221799273,18cyclictest8050irq/56-dwc_otg_20:54:112
32217992712,7cyclictest2895350wget20:34:042
3221699271,4cyclictest8050irq/56-dwc_otg_20:33:501
303902274,13sleep130404-21apt-get19:09:021
3221899261,7cyclictest20119-21cut20:09:073
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional