You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 09:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sat Apr 27, 2024 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1214921740,1sleep10-21swapper/121:48:231
3084991056,74cyclictest0-21swapper/021:47:340
281422970,5sleep00-21swapper/000:07:460
141402950,4sleep3381ktimersoftd/323:50:583
3084998826,45cyclictest15177-21sort22:32:390
201312870,2sleep10-21swapper/121:58:051
3084998524,25cyclictest13-21rcuc/023:37:300
7922840,6sleep2308699cyclictest22:54:222
3084998422,46cyclictest31143-21latency_hist23:32:210
3084998422,46cyclictest31143-21latency_hist23:32:210
308499841,72cyclictest0-21swapper/023:02:330
308499834,71cyclictest26647-21rm23:26:550
3084998123,40cyclictest8150irq/56-dwc_otg_22:02:200
3084998021,4cyclictest30765-21cut21:32:330
308499801,58cyclictest0-21swapper/023:43:080
3084997821,42cyclictest26872-21cpuspeed20:17:320
308499781,63cyclictest16925-21aten_rbpower_cu00:37:320
308499762,21cyclictest0-21swapper/022:37:440
308499751,24cyclictest8612-21latency_hist20:57:210
308499751,24cyclictest8612-21latency_hist20:57:210
3084997418,4cyclictest24638-21cron20:12:190
3084997415,9cyclictest11229-21/usr/sbin/munin21:02:440
3084997415,48cyclictest0-21swapper/000:04:470
157622740,5sleep2308699cyclictest19:47:202
308799737,31cyclictest39-21ksoftirqd/323:37:303
308499731,41cyclictest0-21swapper/020:37:320
308499731,11cyclictest0-21swapper/023:10:520
308499721,53cyclictest0-21swapper/023:12:350
308499721,24cyclictest27916-21cat22:07:490
308499713,13cyclictest0-21swapper/022:30:060
308499711,12cyclictest0-21swapper/022:44:500
3084997023,4cyclictest8050irq/56-dwc_otg_22:57:090
3084997021,5cyclictest6441-21cron23:02:190
308499701,22cyclictest0-21swapper/021:16:160
308499701,12cyclictest0-21swapper/021:57:010
308499693,26cyclictest0-21swapper/022:02:310
3084996921,40cyclictest0-21swapper/020:22:460
3084996917,40cyclictest0-21swapper/021:29:500
3084996916,4cyclictest8050irq/56-dwc_otg_21:41:010
3084996913,40cyclictest11544-21sh00:29:060
3084996912,48cyclictest0-21swapper/020:52:200
3084996819,27cyclictest1292-21runrttasks19:57:450
308699677,8cyclictest8150irq/56-dwc_otg_00:32:292
308499676,55cyclictest0-21swapper/019:37:300
308499672,23cyclictest1292-21runrttasks21:27:060
3084996718,39cyclictest0-21swapper/023:35:030
308499671,23cyclictest0-21swapper/019:56:460
3084996618,4cyclictest8150irq/56-dwc_otg_21:18:590
308499661,21cyclictest0-21swapper/023:18:490
3084996528,28cyclictest8150irq/56-dwc_otg_00:23:420
3084996522,34cyclictest8050irq/56-dwc_otg_22:26:470
3084996516,41cyclictest9157-21interrupts20:57:420
308499648,48cyclictest0-21swapper/022:52:040
3084996411,4cyclictest8050irq/56-dwc_otg_00:12:340
308499638,15cyclictest0-21swapper/023:48:550
3084996314,9cyclictest0-21swapper/000:18:180
308499631,23cyclictest0-21swapper/019:18:130
308499631,12cyclictest0-21swapper/023:56:200
3084996215,8cyclictest0-21swapper/022:16:050
3084996215,8cyclictest0-21swapper/022:16:050
22212620,6sleep1221ktimersoftd/119:07:481
3084996112,11cyclictest0-21swapper/000:33:230
308499601,19cyclictest0-21swapper/021:43:210
3084996011,7cyclictest0-21swapper/022:17:220
308499601,17cyclictest0-21swapper/000:00:040
3084995917,4cyclictest7950irq/56-dwc_otg21:07:500
308499591,17cyclictest0-21swapper/020:43:550
3084995814,10cyclictest0-21swapper/019:33:360
3084995811,9cyclictest0-21swapper/020:12:380
3084995713,3cyclictest0-21swapper/019:51:370
308499562,20cyclictest0-21swapper/020:07:050
308499562,20cyclictest0-21swapper/020:07:050
308499561,32cyclictest7913-21unixbench_singl19:22:500
308499561,32cyclictest7913-21unixbench_singl19:22:500
308499561,13cyclictest0-21swapper/019:44:110
308699545,9cyclictest30960-21ssh00:12:302
308499541,15cyclictest0-21swapper/020:35:570
308699534,13cyclictest2310-21ssh00:17:292
308499531,8cyclictest0-21swapper/019:12:560
308499531,11cyclictest0-21swapper/020:30:580
3084995211,3cyclictest0-21swapper/019:31:210
308799496,11cyclictest31104-21ssh22:52:313
308699497,27cyclictest0-21swapper/219:37:302
308799483,29cyclictest8150irq/56-dwc_otg_22:07:193
308799482,5cyclictest7950irq/56-dwc_otg21:52:343
308699472,10cyclictest0-21swapper/221:57:282
308799463,8cyclictest0-21swapper/319:12:313
27052463,12sleep00-21swapper/019:10:560
308599457,23cyclictest0-21swapper/119:37:301
308699447,25cyclictest0-21swapper/220:12:302
3085994412,5cyclictest0-21swapper/122:59:591
3087994319,5cyclictest8491-21latency_hist20:57:203
3087994319,5cyclictest8491-21latency_hist20:57:203
3085994314,17cyclictest0-21swapper/120:27:501
205132430,2sleep20-21swapper/222:38:192
308799427,3cyclictest7950irq/56-dwc_otg22:22:343
308699429,4cyclictest0-21swapper/223:17:482
308699426,22cyclictest2943-21sh23:37:252
3086994222,4cyclictest17232-21tune2fs00:37:372
308599421,25cyclictest14623-21ssh21:52:341
308799416,21cyclictest0-21swapper/323:12:343
308799415,22cyclictest0-21swapper/322:12:513
308799415,22cyclictest0-21swapper/322:12:513
3087994120,6cyclictest23585-21fschecks_count00:02:373
308699418,14cyclictest8150irq/56-dwc_otg_00:02:442
308699415,23cyclictest15212-21ssh23:52:322
3086994113,5cyclictest0-21swapper/222:25:122
308599416,18cyclictest0-21swapper/123:27:321
308599416,18cyclictest0-21swapper/123:27:321
3085994123,11cyclictest26359-21ssh22:46:411
3085994117,5cyclictest28781-21fschecks_count20:22:361
308599411,25cyclictest0-21swapper/119:27:311
306592410,3sleep30-21swapper/320:27:383
308799406,4cyclictest0-21swapper/321:32:493
308799406,3cyclictest0-21swapper/323:17:303
3087994018,5cyclictest10198-21latency_hist19:32:193
308699409,13cyclictest0-21swapper/222:36:102
308699403,9cyclictest0-21swapper/221:37:322
308699402,31cyclictest8150irq/56-dwc_otg_23:12:312
308599403,12cyclictest0-21swapper/100:17:291
3085994022,4cyclictest23577-21idleruntime23:22:401
3085994018,4cyclictest13884-21diskmemload22:02:411
308799395,5cyclictest7950irq/56-dwc_otg23:57:313
308699397,27cyclictest0-21swapper/222:57:342
308699396,18cyclictest0-21swapper/222:04:112
308599392,3cyclictest0-21swapper/123:52:311
3085993919,11cyclictest8150irq/56-dwc_otg_23:42:381
308599391,29cyclictest0-21swapper/123:17:351
3085993911,19cyclictest0-21swapper/100:04:071
308799387,25cyclictest0-21swapper/321:17:313
308799382,2cyclictest0-21swapper/322:42:323
308699381,21cyclictest8150irq/56-dwc_otg_22:07:252
308599386,23cyclictest8150irq/56-dwc_otg_22:47:311
308599386,17cyclictest0-21swapper/122:37:341
308599384,15cyclictest13893-21modprobe21:12:191
308599381,23cyclictest0-21swapper/119:32:241
308599381,13cyclictest13884-21diskmemload21:32:371
308799377,21cyclictest0-21swapper/322:07:343
308799371,3cyclictest0-21swapper/323:02:503
308699379,13cyclictest0-21swapper/200:27:422
3086993715,13cyclictest301ktimersoftd/223:58:222
308599379,8cyclictest0-21swapper/121:37:331
308599377,23cyclictest0-21swapper/120:12:301
308599372,23cyclictest30819-21ls22:12:201
3085993717,5cyclictest4935-21/usr/sbin/munin19:17:311
308599371,4cyclictest8150irq/56-dwc_otg_19:12:311
308599371,24cyclictest0-21swapper/119:47:301
308599371,22cyclictest7950irq/56-dwc_otg23:15:071
308599370,29cyclictest0-21swapper/121:17:451
308799368,23cyclictest0-21swapper/320:22:313
308799367,25cyclictest0-21swapper/321:22:343
308799367,25cyclictest0-21swapper/319:17:313
308799361,19cyclictest32612-21users23:32:523
3086993613,10cyclictest8150irq/56-dwc_otg_23:32:292
308599367,20cyclictest0-21swapper/120:57:331
308599361,22cyclictest0-21swapper/121:27:421
183012362,30sleep30-21swapper/323:56:113
308799357,25cyclictest0-21swapper/320:47:333
308799357,25cyclictest0-21swapper/319:32:243
308799356,19cyclictest0-21swapper/323:27:313
308799356,19cyclictest0-21swapper/323:27:313
308799354,16cyclictest8150irq/56-dwc_otg_00:36:563
308799353,10cyclictest0-21swapper/300:17:283
308799351,5cyclictest13837-21rm23:10:583
3087993514,4cyclictest26614-21cut21:27:323
308799351,20cyclictest0-21swapper/322:38:163
308699357,22cyclictest0-21swapper/221:42:332
308699353,4cyclictest8150irq/56-dwc_otg_21:47:472
308699352,5cyclictest11008-21df_inode22:27:342
308599358,6cyclictest7950irq/56-dwc_otg22:22:481
308599357,11cyclictest8150irq/56-dwc_otg_19:42:551
308599352,5cyclictest0-21swapper/120:02:321
308599352,5cyclictest0-21swapper/120:02:321
3085993519,10cyclictest0-21swapper/122:18:241
3085993512,11cyclictest11959-21grep23:07:491
3085993510,4cyclictest32258-21unixbench_multi22:12:521
3085993510,4cyclictest32258-21unixbench_multi22:12:521
277932350,5sleep2308699cyclictest23:27:432
277932350,5sleep2308699cyclictest23:27:432
113332350,1sleep10-21swapper/123:47:341
308799347,24cyclictest14875-21ssh22:32:333
308799347,15cyclictest0-21swapper/320:32:323
308799343,5cyclictest7950irq/56-dwc_otg19:22:353
308799343,5cyclictest7950irq/56-dwc_otg19:22:353
308799341,6cyclictest27910-21ntp_states00:07:433
308699344,18cyclictest8150irq/56-dwc_otg_19:52:472
308699342,16cyclictest8050irq/56-dwc_otg_19:29:552
308599348,9cyclictest0-21swapper/122:55:041
308599346,17cyclictest0-21swapper/123:37:251
308599343,17cyclictest0-21swapper/119:27:181
308599343,17cyclictest0-21swapper/119:27:181
308599342,5cyclictest787-21tail20:32:491
3085993420,4cyclictest1292-21runrttasks00:07:301
3085993416,4cyclictest22403-21/usr/sbin/munin21:22:351
308799337,6cyclictest8150irq/56-dwc_otg_20:42:353
308799334,6cyclictest8050irq/56-dwc_otg_21:57:473
308799333,13cyclictest8150irq/56-dwc_otg_20:12:353
308799332,5cyclictest8150irq/56-dwc_otg_00:37:313
308799332,14cyclictest8150irq/56-dwc_otg_00:27:523
308799331,4cyclictest8050irq/56-dwc_otg_21:39:493
308799331,15cyclictest7950irq/56-dwc_otg19:57:323
3087993310,12cyclictest0-21swapper/322:48:453
308699338,14cyclictest0-21swapper/223:26:362
308699335,16cyclictest8150irq/56-dwc_otg_23:02:422
3086993315,4cyclictest18705-21grep21:17:442
308699331,4cyclictest0-21swapper/200:22:432
308699331,22cyclictest0-21swapper/222:52:192
308699331,14cyclictest8050irq/56-dwc_otg_20:37:412
3086993310,11cyclictest26668-21sh22:47:162
308599337,6cyclictest16873-21/usr/sbin/munin00:37:491
308599332,17cyclictest0-21swapper/122:37:201
308599331,15cyclictest0-21swapper/120:47:201
3085993311,3cyclictest0-21swapper/100:13:551
3085993311,10cyclictest0-21swapper/122:27:301
19332336,17sleep31252-21/usr/sbin/munin19:07:433
308799329,10cyclictest0-21swapper/300:16:483
308799327,14cyclictest0-21swapper/322:17:313
308799325,9cyclictest26873-21cron23:27:203
308799321,17cyclictest7661-21ssh21:42:503
3087993211,4cyclictest7950irq/56-dwc_otg21:12:523
3087993210,5cyclictest8150irq/56-dwc_otg_19:37:283
308699329,4cyclictest0-21swapper/221:26:482
308699328,6cyclictest8050irq/56-dwc_otg_20:02:342
308699328,6cyclictest8050irq/56-dwc_otg_20:02:342
308699328,4cyclictest8050irq/56-dwc_otg_00:09:152
308699327,5cyclictest31-21ksoftirqd/222:17:282
308699326,17cyclictest8150irq/56-dwc_otg_20:57:332
308699326,14cyclictest0-21swapper/221:02:312
308699326,11cyclictest293392rm21:30:292
308699322,5cyclictest14747-21/usr/sbin/munin21:52:362
308699321,8cyclictest7844-21ntpq23:42:432
308699321,17cyclictest16542-21ntpq19:47:402
3086993211,6cyclictest29604-21unixbench_multi20:22:502
308599329,4cyclictest0-21swapper/100:25:451
308599325,6cyclictest8050irq/56-dwc_otg_20:37:381
308599325,6cyclictest19541-21fschecks_count23:57:361
308599325,5cyclictest20572-21grep19:57:521
308599322,14cyclictest0-21swapper/120:19:291
308599321,8cyclictest0-21swapper/100:27:331
3085993217,7cyclictest23072-21/usr/sbin/munin20:07:411
3085993216,5cyclictest14035-21ntp_offset00:32:441
3085993213,6cyclictest32047-21/usr/sbin/munin23:32:431
308599321,23cyclictest0-21swapper/120:47:431
308799318,4cyclictest8150irq/56-dwc_otg_21:07:513
3087993110,4cyclictest0-21swapper/322:59:593
308699318,5cyclictest8150irq/56-dwc_otg_19:37:192
308699318,5cyclictest31068-21ls21:32:382
308699318,4cyclictest8150irq/56-dwc_otg_19:57:442
308699318,4cyclictest8050irq/56-dwc_otg_20:42:292
308699313,5cyclictest8050irq/56-dwc_otg_19:22:282
308699313,5cyclictest8050irq/56-dwc_otg_19:22:282
3086993117,4cyclictest15592-21vmstat21:12:532
308699311,5cyclictest0-21swapper/223:07:452
308599312,15cyclictest11611-21grep21:02:491
308599311,21cyclictest0-21swapper/123:06:251
308799309,4cyclictest0-21swapper/322:29:483
308799309,4cyclictest0-21swapper/321:47:383
308799306,12cyclictest0-21swapper/320:37:333
308799303,5cyclictest8050irq/56-dwc_otg_20:17:493
308799302,19cyclictest0-21swapper/321:01:423
308799302,19cyclictest0-21swapper/320:05:473
308799302,19cyclictest0-21swapper/320:05:473
308799301,18cyclictest17961-21cut19:52:353
308699306,14cyclictest0-21swapper/223:47:322
308699303,5cyclictest0-21swapper/219:17:482
308699303,12cyclictest8050irq/56-dwc_otg_22:13:282
308699303,12cyclictest8050irq/56-dwc_otg_22:13:282
308699301,7cyclictest28379-21latency_hist20:22:202
3085993013,8cyclictest7950irq/56-dwc_otg21:12:341
308799294,4cyclictest0-21swapper/300:22:563
308699296,5cyclictest7950irq/56-dwc_otg21:07:422
308699295,5cyclictest31-21ksoftirqd/219:12:422
308699294,4cyclictest7950irq/56-dwc_otg20:52:372
308699294,4cyclictest7950irq/56-dwc_otg20:52:372
308699292,15cyclictest5220-21aten_rbpower_vo20:47:342
308599294,7cyclictest8150irq/56-dwc_otg_20:52:371
308599294,7cyclictest8150irq/56-dwc_otg_20:52:371
308599294,4cyclictest0-21swapper/121:42:391
3085992912,5cyclictest19092-21taskset19:55:341
308799281,5cyclictest7950irq/56-dwc_otg21:07:193
3087992813,4cyclictest7308-21awk23:42:353
308699283,12cyclictest8150irq/56-dwc_otg_20:32:412
308699282,6cyclictest8150irq/56-dwc_otg_20:27:382
308699282,19cyclictest0-21swapper/220:07:322
308799275,7cyclictest14064-21apt-get19:42:343
308799262,14cyclictest8150irq/56-dwc_otg_19:47:433
308799261,11cyclictest0-21swapper/320:07:323
11062263,12sleep20-21swapper/219:07:222
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional