You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-20 - 08:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot7s.osadl.org (updated Thu Jun 20, 2024 00:43:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2578482211670,20sleep10-21swapper/119:05:391
2578790211473,33sleep30-21swapper/319:09:343
2577401210273,21sleep20-21swapper/219:05:162
2578697210072,20sleep00-21swapper/019:08:230
257899299688,41cyclictest0-21swapper/021:54:340
257899999280,4cyclictest0-21swapper/221:49:592
257899299270,3cyclictest0-21swapper/022:24:090
257899299270,25cyclictest2647088-21ntpq21:55:210
257899999250,25cyclictest0-21swapper/223:17:112
257899999250,16cyclictest0-21swapper/219:37:582
2578992992511,13cyclictest0-21swapper/021:33:240
257899299250,25cyclictest0-21swapper/023:07:590
257899299250,1cyclictest0-21swapper/020:21:200
2578999992111,10cyclictest0-21swapper/220:05:202
257899999206,14cyclictest0-21swapper/222:34:552
257899299202,16cyclictest2657795-21kworker/0:0+kacpid22:57:350
257899299190,4cyclictest0-21swapper/021:25:280
2578999991812,6cyclictest0-21swapper/223:25:182
257899999180,3cyclictest0-21swapper/222:00:292
257899299188,5cyclictest0-21swapper/023:26:060
257899299180,3cyclictest0-21swapper/022:39:260
257899299180,17cyclictest0-21swapper/023:35:030
2578995991715,1cyclictest1038-21snmpd22:29:571
257899299170,3cyclictest0-21swapper/019:54:290
257899299170,16cyclictest0-21swapper/020:47:210
257899299170,16cyclictest0-21swapper/020:13:300
257899299170,16cyclictest0-21swapper/000:00:040
2579001991615,1cyclictest2578987-21cyclictest22:29:573
2579001991613,2cyclictest1038-21snmpd23:03:533
257899999163,13cyclictest0-21swapper/219:49:022
257899999160,7cyclictest0-21swapper/222:36:162
257899999160,7cyclictest0-21swapper/221:24:072
257899999160,2cyclictest0-21swapper/200:23:322
257899999160,16cyclictest0-21swapper/223:58:492
257899999160,16cyclictest0-21swapper/221:40:052
257899999160,16cyclictest0-21swapper/221:40:042
257899999160,16cyclictest0-21swapper/221:35:582
257899999160,16cyclictest0-21swapper/221:33:562
257899999160,16cyclictest0-21swapper/220:18:352
257899299167,9cyclictest0-21swapper/022:47:460
257899299167,9cyclictest0-21swapper/020:32:090
257899299160,7cyclictest0-21swapper/023:12:020
257899299160,16cyclictest0-21swapper/021:12:310
257899299160,16cyclictest0-21swapper/019:42:280
257899299160,15cyclictest2632003-21sd-close21:19:590
257899299160,15cyclictest0-21swapper/022:05:180
257899299160,15cyclictest0-21swapper/020:16:150
143599160,1ntpd0-21swapper/222:45:242
2579001991512,2cyclictest1038-21snmpd19:22:373
257899999150,6cyclictest0-21swapper/222:05:432
257899999150,6cyclictest0-21swapper/221:51:482
257899999150,15cyclictest0-21swapper/223:31:302
257899999150,15cyclictest0-21swapper/220:47:062
257899999150,15cyclictest0-21swapper/220:22:272
257899999150,15cyclictest0-21swapper/219:57:092
2578992991510,5cyclictest0-21swapper/023:56:520
257899299150,6cyclictest0-21swapper/023:16:180
257899299150,6cyclictest0-21swapper/020:01:270
257899299150,15cyclictest0-21swapper/019:29:100
217799150,2rtkit-daemon1038-21snmpd00:29:220
143599150,0ntpd0-21swapper/121:45:201
2579001991412,1cyclictest1038-21snmpd00:06:013
257899999145,9cyclictest0-21swapper/223:48:572
257899999145,9cyclictest0-21swapper/221:15:112
257899999145,9cyclictest0-21swapper/200:09:512
2578999991412,2cyclictest0-21swapper/220:10:182
2578999991410,4cyclictest0-21swapper/200:30:132
257899999140,1cyclictest0-21swapper/222:20:192
257899999140,1cyclictest0-21swapper/219:40:232
2578995991412,1cyclictest1038-21snmpd23:02:001
2578995991412,1cyclictest0-21swapper/122:07:581
257899299144,4cyclictest0-21swapper/023:23:260
2578992991411,2cyclictest1038-21snmpd21:22:230
217799140,0rtkit-daemon0-21swapper/022:11:400
143599140,6ntpd2689033-21ntpq23:40:210
2579001991311,1cyclictest1038-21snmpd22:16:513
257899999139,1cyclictest0-21swapper/222:19:362
257899999138,5cyclictest0-21swapper/200:17:402
2578999991312,1cyclictest0-21swapper/223:50:132
2578999991312,1cyclictest0-21swapper/221:25:252
257899999130,1cyclictest0-21swapper/222:25:192
257899999130,13cyclictest0-21swapper/223:35:102
257899999130,13cyclictest0-21swapper/220:38:512
257899999130,13cyclictest0-21swapper/220:30:112
257899999130,13cyclictest0-21swapper/219:50:192
257899999130,13cyclictest0-21swapper/219:15:142
257899999130,13cyclictest0-21swapper/200:38:512
257899999130,13cyclictest0-21swapper/200:25:192
2578995991311,1cyclictest0-21swapper/121:26:161
257899599130,13cyclictest0-21swapper/100:06:011
257899299139,4cyclictest0-21swapper/000:30:590
2578992991310,2cyclictest1038-21snmpd20:05:560
257899299130,1cyclictest0-21swapper/022:30:200
257899299130,1cyclictest0-21swapper/021:00:210
257899299130,13cyclictest2590583-21ntpq19:35:230
257899299130,13cyclictest0-21swapper/022:25:220
257899299130,13cyclictest0-21swapper/019:45:270
257900199129,2cyclictest762-21gdbus20:01:143
257900199129,2cyclictest1038-21snmpd23:33:363
257900199129,2cyclictest1038-21snmpd21:26:163
257900199129,2cyclictest1038-21snmpd19:34:323
2579001991210,1cyclictest1038-21snmpd23:26:223
2579001991210,1cyclictest1038-21snmpd22:07:583
2579001991210,1cyclictest1038-21snmpd21:32:483
2579001991210,1cyclictest1038-21snmpd21:17:593
2579001991210,1cyclictest1032-21nmbd19:16:023
257899999129,2cyclictest1038-21snmpd20:03:422
257899999128,4cyclictest0-21swapper/222:44:312
257899999128,4cyclictest0-21swapper/221:00:282
257899999123,9cyclictest0-21swapper/223:09:232
257899999123,9cyclictest0-21swapper/219:34:382
257899999123,3cyclictest0-21swapper/221:07:382
257899599129,2cyclictest1038-21snmpd23:18:261
257899599129,2cyclictest1038-21snmpd20:42:341
2578995991211,1cyclictest0-21swapper/122:50:401
2578995991211,1cyclictest0-21swapper/100:30:261
2578995991210,1cyclictest1038-21snmpd23:12:591
257899299129,2cyclictest1038-21snmpd23:49:330
257899299129,2cyclictest1038-21snmpd20:27:250
257899299127,4cyclictest0-21swapper/023:01:530
257900199119,2cyclictest2640810-21awk21:40:173
257900199119,2cyclictest2640810-21awk21:40:173
257900199119,1cyclictest1038-21snmpd23:38:453
257900199119,1cyclictest1038-21snmpd23:24:053
257900199119,1cyclictest1038-21snmpd22:50:403
257900199119,1cyclictest1038-21snmpd21:08:533
257900199119,1cyclictest1038-21snmpd20:32:123
257900199119,1cyclictest1038-21snmpd20:21:183
257900199119,1cyclictest1038-21snmpd19:39:583
257900199119,1cyclictest1038-21snmpd00:22:073
257900199119,1cyclictest1032-21nmbd21:51:423
257900199118,2cyclictest2603898-21920:09:593
257899999119,1cyclictest1038-21snmpd19:29:082
257899999118,2cyclictest1038-21snmpd23:01:502
257899599119,2cyclictest1038-21snmpd00:37:411
257899599119,1cyclictest1038-21snmpd22:21:401
257899599119,1cyclictest1038-21snmpd22:15:421
257899599119,1cyclictest1038-21snmpd21:59:421
257899599119,1cyclictest1038-21snmpd21:35:501
257899599119,1cyclictest1038-21snmpd21:17:071
257899599119,1cyclictest1038-21snmpd20:20:271
257899599119,1cyclictest1038-21snmpd19:46:351
257899599119,1cyclictest1038-21snmpd19:17:131
257899599111,9cyclictest2591765-21/usr/sbin/munin19:39:581
257899299119,1cyclictest1038-21snmpd22:52:310
257899299119,1cyclictest1038-21snmpd19:19:430
257899299118,2cyclictest1038-21snmpd23:53:150
257899299118,2cyclictest1038-21snmpd23:30:150
257899299118,2cyclictest1038-21snmpd21:07:200
257899299116,5cyclictest0-21swapper/019:59:120
2578992991110,1cyclictest171ktimers/020:58:530
2578992991110,1cyclictest1038-21snmpd00:16:550
257900199109,1cyclictest1038-21snmpd20:50:283
257900199109,1cyclictest1038-21snmpd00:30:263
257900199108,1cyclictest1038-21snmpd21:56:263
257900199108,1cyclictest1038-21snmpd21:22:403
257900199108,1cyclictest1038-21snmpd19:55:513
257900199108,1cyclictest1038-21snmpd19:26:383
257900199107,2cyclictest1038-21snmpd19:44:593
257899999109,1cyclictest0-21swapper/220:40:162
257899999108,1cyclictest1038-21snmpd21:57:112
257899999107,2cyclictest2652679-21fschecks_time22:10:112
257899999105,5cyclictest0-21swapper/222:50:552
257899999105,5cyclictest0-21swapper/200:13:282
257899999101,9cyclictest41-21ksoftirqd/222:55:142
257899999100,10cyclictest0-21swapper/223:13:592
257899999100,10cyclictest0-21swapper/220:51:342
257899999100,10cyclictest0-21swapper/200:03:312
257899599109,1cyclictest1038-21snmpd23:57:371
257899599109,1cyclictest1038-21snmpd21:54:021
257899599109,1cyclictest1038-21snmpd20:47:331
257899599109,1cyclictest1038-21snmpd20:04:301
257899599109,1cyclictest1038-21snmpd19:40:531
257899599108,2cyclictest1038-21snmpd20:38:371
257899599108,1cyclictest1038-21snmpd23:39:271
257899599108,1cyclictest1038-21snmpd22:39:081
257899599108,1cyclictest1038-21snmpd21:07:591
257899599108,1cyclictest1038-21snmpd20:28:461
257899599108,1cyclictest1038-21snmpd20:06:141
257899599108,1cyclictest1038-21snmpd00:16:491
257899599107,2cyclictest2692748-21awk23:50:131
257899599107,2cyclictest2620713-21fschecks_time20:50:141
257899599107,2cyclictest1038-21snmpd00:02:071
257899299109,1cyclictest1038-21snmpd22:41:340
257899299108,2cyclictest1038-21snmpd21:42:300
257899299108,2cyclictest1038-21snmpd21:42:290
257899299108,1cyclictest1038-21snmpd00:24:350
257899299106,1cyclictest0-21swapper/020:43:280
257899299100,10cyclictest0-21swapper/021:46:560
257899299100,10cyclictest0-21swapper/020:39:210
143599100,2ntpd2580980-21latency_hist19:14:582
2606857290,3sleep32606907-21sed20:15:223
25790019998,1cyclictest2663147-21tr22:35:263
25790019998,1cyclictest2656888-21wc22:20:153
25790019997,2cyclictest2690934-21needreboot23:45:193
25790019997,1cyclictest1038-21snmpd23:42:363
25790019997,1cyclictest1038-21snmpd20:48:483
25790019997,1cyclictest1038-21snmpd19:45:533
25790019997,1cyclictest1038-21snmpd00:13:553
25790019997,1cyclictest1032-21nmbd22:56:313
25790019997,1cyclictest1032-21nmbd22:03:513
25790019997,1cyclictest1032-21nmbd19:52:213
25790019995,3cyclictest3019342-21gnome-shell19:14:593
25789999997,1cyclictest1038-21snmpd20:26:282
25789999991,2cyclictest2630151-21sed21:14:592
25789999990,9cyclictest0-21swapper/223:21:412
25789959997,1cyclictest798-21gdbus23:49:591
25789959997,1cyclictest1038-21snmpd23:20:111
25789959997,1cyclictest1038-21snmpd21:42:511
25789959997,1cyclictest1038-21snmpd21:42:501
25789959997,1cyclictest1038-21snmpd21:32:121
25789959997,1cyclictest1038-21snmpd21:13:551
25789959997,1cyclictest1038-21snmpd21:01:341
25789959997,1cyclictest1038-21snmpd00:27:381
25789959996,2cyclictest1038-21snmpd22:57:561
25789959996,2cyclictest1038-21snmpd22:01:321
25789959996,2cyclictest1038-21snmpd20:14:061
25789959996,2cyclictest1038-21snmpd19:56:001
25789929997,1cyclictest732-21avahi-daemon19:24:590
25789929997,1cyclictest2638816-21awk21:35:170
25789929997,1cyclictest1038-21snmpd19:30:410
25789929997,1cyclictest1038-21snmpd00:11:190
25789929997,1cyclictest1038-21snmpd00:05:490
25789929995,4cyclictest0-21swapper/019:11:450
25789929994,5cyclictest0-21swapper/000:38:160
25789929990,9cyclictest0-21swapper/022:02:080
14359990,1ntpd2661056-21ntpq22:30:193
14359990,1ntpd2621083-21ldconfig20:50:190
14359990,1ntpd2584324-21if_p4p119:20:172
14359990,1ntpd0-21swapper/320:25:193
14359990,1ntpd0-21swapper/122:30:181
25790019987,1cyclictest491ktimers/320:55:253
25790019987,1cyclictest1038-21snmpd23:13:263
25790019987,1cyclictest1038-21snmpd20:36:523
25790019987,1cyclictest1032-21nmbd23:16:413
25790019987,1cyclictest0-21swapper/320:42:333
25790019987,1cyclictest0-21swapper/300:37:413
25790019986,2cyclictest2696973-21ntpq00:00:203
25790019986,1cyclictest1038-21snmpd23:56:313
25790019986,1cyclictest1038-21snmpd22:10:213
25790019986,1cyclictest1032-21nmbd23:06:323
25790019985,2cyclictest1038-21snmpd21:10:463
25789959987,1cyclictest1038-21snmpd23:31:001
25789959987,1cyclictest1038-21snmpd22:46:221
25789959987,1cyclictest0-21swapper/119:50:521
25789959986,1cyclictest758-21systemd-machine19:14:581
25789959985,2cyclictest2584529-21needreboot19:20:281
25789959985,2cyclictest1038-21snmpd23:44:011
14359980,1ntpd2654930-21memory22:15:190
14359980,0ntpd0-21swapper/321:45:203
14359980,0ntpd0-21swapper/223:40:202
14359980,0ntpd0-21swapper/220:55:132
25790019976,1cyclictest1038-21snmpd22:48:353
25790019976,1cyclictest1038-21snmpd00:26:263
25790019976,1cyclictest1038-21snmpd00:19:133
25790019975,1cyclictest1038-21snmpd23:53:303
25790019975,1cyclictest1038-21snmpd20:11:543
25789959976,1cyclictest2704981-21ntpq00:20:201
25789959976,1cyclictest2682772-21awk23:25:151
25789959976,1cyclictest2613549-21unixbench_multi20:30:271
25789959976,1cyclictest1038-21snmpd22:41:581
25789959976,1cyclictest1038-21snmpd00:10:221
25789959975,1cyclictest1038-21snmpd20:56:341
25789959975,1cyclictest1038-21snmpd19:27:281
25789959974,3cyclictest3019305-21Xorg21:22:001
25789959970,7cyclictest0-21swapper/123:06:321
25789959970,7cyclictest0-21swapper/120:16:531
25790019960,1cyclictest2665054-21ntpq22:40:183
25790019960,1cyclictest2639275-21smart_sda21:35:263
25789959965,1cyclictest0-21swapper/122:12:121
25789959964,1cyclictest1038-21snmpd19:32:441
14359960,0ntpd0-21swapper/321:00:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional