You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-23 - 21:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Tue Apr 23, 2024 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
210521160,4sleep00-21swapper/009:25:350
1791911050,4ptp4l401ktimersoftd/309:20:383
2104997257,6cyclictest25-21ksoftirqd/114:45:541
2104997158,5cyclictest25-21ksoftirqd/113:00:531
2104997157,6cyclictest25-21ksoftirqd/110:20:471
2104997057,6cyclictest25-21ksoftirqd/113:20:521
2104997055,7cyclictest25-21ksoftirqd/109:50:491
2104996955,7cyclictest25-21ksoftirqd/114:35:531
322912680,2sleep20-21swapper/214:11:502
179191670,1ptp4l401ktimersoftd/312:20:573
64152640,2sleep00-21swapper/011:37:390
179191620,1ptp4l401ktimersoftd/314:29:353
179191570,1ptp4l401ktimersoftd/314:25:223
2104995648,3cyclictest25-21ksoftirqd/109:55:471
98492550,2sleep20-21swapper/210:45:552
326362555,37sleep20-21swapper/209:21:142
2104995443,5cyclictest25-21ksoftirqd/114:25:551
2104995441,5cyclictest25-21ksoftirqd/110:40:481
324232520,2sleep00-21swapper/014:12:080
2120995144,4cyclictest41-21ksoftirqd/312:05:493
31092500,2sleep30-21swapper/312:16:003
2104995038,6cyclictest25-21ksoftirqd/109:35:441
2104995037,6cyclictest25-21ksoftirqd/109:45:481
2120994843,3cyclictest41-21ksoftirqd/313:05:513
2104994837,5cyclictest25-21ksoftirqd/111:50:491
2104994825,12cyclictest1779-21runrttasks10:55:501
2120994740,4cyclictest41-21ksoftirqd/311:20:503
2104994740,3cyclictest25-21ksoftirqd/114:05:511
208182470,2sleep00-21swapper/010:00:560
2104994618,4cyclictest25-21ksoftirqd/114:15:411
179191460,1ptp4l401ktimersoftd/314:32:063
2120994537,4cyclictest41-21ksoftirqd/311:25:483
2104994539,3cyclictest25-21ksoftirqd/112:55:541
2120994438,3cyclictest41-21ksoftirqd/314:15:523
2104994437,3cyclictest25-21ksoftirqd/112:40:441
2104994433,4cyclictest25-21ksoftirqd/112:10:471
2104994418,4cyclictest25-21ksoftirqd/113:50:531
2120994337,3cyclictest41-21ksoftirqd/311:10:473
2120994335,4cyclictest41-21ksoftirqd/311:15:503
2104994337,3cyclictest25-21ksoftirqd/114:50:541
2104994216,4cyclictest25-21ksoftirqd/112:05:531
2120994133,4cyclictest41-21ksoftirqd/310:10:433
2111994128,11cyclictest33-21ksoftirqd/211:35:372
2120994032,4cyclictest41-21ksoftirqd/311:40:513
2104994026,3cyclictest25-21ksoftirqd/113:10:391
2104993933,3cyclictest25-21ksoftirqd/114:20:521
2104993933,3cyclictest25-21ksoftirqd/112:35:391
2104993930,7cyclictest25-21ksoftirqd/112:36:151
2104993915,4cyclictest25-21ksoftirqd/110:15:511
179191390,1ptp4l401ktimersoftd/314:14:453
179191390,1ptp4l401ktimersoftd/314:06:503
179191390,1ptp4l401ktimersoftd/312:57:583
179191390,1ptp4l401ktimersoftd/312:00:503
2104993832,3cyclictest25-21ksoftirqd/114:35:421
2104993824,3cyclictest25-21ksoftirqd/110:25:521
2104993821,14cyclictest25-21ksoftirqd/114:01:061
2104993812,4cyclictest25-21ksoftirqd/111:30:521
2104993811,4cyclictest25-21ksoftirqd/113:25:551
179191380,1ptp4l401ktimersoftd/314:43:373
179191380,1ptp4l401ktimersoftd/314:01:043
179191380,1ptp4l401ktimersoftd/313:59:213
179191380,1ptp4l401ktimersoftd/313:54:363
179191380,1ptp4l401ktimersoftd/313:42:373
179191380,1ptp4l401ktimersoftd/313:42:373
179191380,1ptp4l401ktimersoftd/313:26:523
179191380,1ptp4l401ktimersoftd/311:55:583
179191380,1ptp4l401ktimersoftd/311:54:223
179191380,1ptp4l401ktimersoftd/311:49:443
179191380,1ptp4l401ktimersoftd/310:45:473
179191380,0ptp4l401ktimersoftd/313:17:263
2111993725,9cyclictest33-21ksoftirqd/210:15:522
2104993732,3cyclictest25-21ksoftirqd/113:45:511
2104993732,3cyclictest25-21ksoftirqd/113:45:511
2104993729,3cyclictest25-21ksoftirqd/110:50:511
2104993726,3cyclictest121rcu_preempt09:25:351
2104993724,3cyclictest25-21ksoftirqd/112:55:401
2104993722,3cyclictest25-21ksoftirqd/112:45:551
2104993718,4cyclictest25-21ksoftirqd/113:15:391
2104993711,7cyclictest25-21ksoftirqd/113:35:531
210499370,7cyclictest121rcu_preempt12:00:571
2098993724,10cyclictest9-21ksoftirqd/012:45:400
179191370,2ptp4l22394-21kworker/3:113:36:063
179191370,1ptp4l401ktimersoftd/314:36:203
179191370,1ptp4l401ktimersoftd/313:11:383
179191370,1ptp4l401ktimersoftd/313:01:063
179191370,1ptp4l401ktimersoftd/312:54:183
179191370,1ptp4l401ktimersoftd/312:46:273
179191370,1ptp4l401ktimersoftd/312:43:253
179191370,1ptp4l401ktimersoftd/312:39:403
179191370,1ptp4l401ktimersoftd/312:28:583
179191370,0ptp4l401ktimersoftd/312:32:373
2120993630,3cyclictest41-21ksoftirqd/313:45:513
2120993630,3cyclictest41-21ksoftirqd/313:45:513
2104993630,4cyclictest25-21ksoftirqd/111:10:371
2104993629,4cyclictest25-21ksoftirqd/111:35:531
2104993622,3cyclictest25-21ksoftirqd/111:21:041
2104993622,11cyclictest25-21ksoftirqd/111:15:581
2104993619,6cyclictest25-21ksoftirqd/110:35:541
2104993613,7cyclictest25-21ksoftirqd/113:31:111
2104993610,4cyclictest25-21ksoftirqd/113:41:141
2104993610,4cyclictest25-21ksoftirqd/113:41:141
179191360,1ptp4l401ktimersoftd/313:23:123
179191360,0ptp4l401ktimersoftd/311:39:323
2120993515,10cyclictest41-21ksoftirqd/309:45:553
2104993530,3cyclictest25-21ksoftirqd/112:30:391
2104993530,3cyclictest25-21ksoftirqd/111:55:531
2104993530,3cyclictest25-21ksoftirqd/111:25:421
2104993529,3cyclictest25-21ksoftirqd/114:00:411
2104993529,3cyclictest25-21ksoftirqd/111:40:531
2104993522,11cyclictest25-21ksoftirqd/112:16:161
2104993520,6cyclictest25-21ksoftirqd/111:01:071
179191350,1ptp4l401ktimersoftd/309:40:373
2104993428,3cyclictest25-21ksoftirqd/113:16:251
2104993421,4cyclictest25-21ksoftirqd/114:16:141
179191340,1ptp4l401ktimersoftd/311:01:023
210499335,3cyclictest121rcu_preempt10:15:361
2104993327,3cyclictest25-21ksoftirqd/111:45:531
2120993227,3cyclictest41-21ksoftirqd/312:15:393
2104993227,3cyclictest25-21ksoftirqd/109:30:561
2104993226,3cyclictest25-21ksoftirqd/114:40:571
2104993226,3cyclictest25-21ksoftirqd/110:01:091
2104993225,4cyclictest25-21ksoftirqd/112:20:561
179191320,1ptp4l401ktimersoftd/311:32:443
179191320,1ptp4l401ktimersoftd/310:37:513
179191320,0ptp4l401ktimersoftd/314:52:193
179191320,0ptp4l401ktimersoftd/314:50:333
2120993122,5cyclictest41-21ksoftirqd/311:05:483
2111993126,3cyclictest33-21ksoftirqd/214:30:422
2111993126,3cyclictest33-21ksoftirqd/212:45:402
2104993125,3cyclictest25-21ksoftirqd/111:15:381
2104993125,3cyclictest25-21ksoftirqd/110:45:491
2104993125,3cyclictest25-21ksoftirqd/109:45:351
2104993125,3cyclictest25-21ksoftirqd/109:25:511
2104993124,4cyclictest25-21ksoftirqd/110:35:361
179191310,1ptp4l401ktimersoftd/309:59:303
179191310,0ptp4l401ktimersoftd/310:09:093
179191310,0ptp4l401ktimersoftd/310:09:093
2120992923,3cyclictest41-21ksoftirqd/310:30:543
2120992923,3cyclictest41-21ksoftirqd/310:00:563
2120992923,3cyclictest41-21ksoftirqd/309:35:343
2111992924,3cyclictest33-21ksoftirqd/211:25:372
211199291,5cyclictest30308-21latency_hist12:50:402
2098992923,3cyclictest9-21ksoftirqd/014:22:140
199582290,2sleep20-21swapper/212:36:152
2120992823,3cyclictest41-21ksoftirqd/310:41:103
2120992822,3cyclictest41-21ksoftirqd/313:31:053
2120992822,3cyclictest41-21ksoftirqd/309:51:103
2120992822,3cyclictest41-21ksoftirqd/309:35:503
2120992819,4cyclictest41-21ksoftirqd/310:15:473
2111992823,3cyclictest33-21ksoftirqd/213:50:592
2111992823,3cyclictest33-21ksoftirqd/212:35:392
2111992822,4cyclictest33-21ksoftirqd/213:11:032
2104992822,3cyclictest25-21ksoftirqd/110:05:551
2104992822,3cyclictest25-21ksoftirqd/110:05:551
2098992822,3cyclictest9-21ksoftirqd/013:09:370
2098992822,3cyclictest9-21ksoftirqd/012:56:160
2098992821,4cyclictest9-21ksoftirqd/012:16:500
2120992721,3cyclictest41-21ksoftirqd/309:30:353
2111992722,3cyclictest33-21ksoftirqd/213:45:522
2111992722,3cyclictest33-21ksoftirqd/213:45:522
2111992722,3cyclictest33-21ksoftirqd/211:50:382
2111992721,3cyclictest33-21ksoftirqd/214:06:002
2111992720,5cyclictest33-21ksoftirqd/211:26:032
2111992720,4cyclictest33-21ksoftirqd/211:14:132
2111992720,4cyclictest33-21ksoftirqd/210:22:502
2111992720,4cyclictest33-21ksoftirqd/209:46:532
2098992721,3cyclictest9-21ksoftirqd/012:05:390
2098992721,3cyclictest9-21ksoftirqd/010:58:130
2098992720,4cyclictest9-21ksoftirqd/009:37:040
179191270,1ptp4l401ktimersoftd/310:20:553
2120992619,4cyclictest41-21ksoftirqd/310:28:573
2111992621,3cyclictest33-21ksoftirqd/213:45:402
2111992621,3cyclictest33-21ksoftirqd/213:45:402
2111992620,3cyclictest33-21ksoftirqd/212:11:022
2111992620,3cyclictest33-21ksoftirqd/211:10:012
2111992620,3cyclictest33-21ksoftirqd/209:39:162
2098992620,3cyclictest9-21ksoftirqd/011:25:150
2098992620,3cyclictest9-21ksoftirqd/011:01:540
2098992620,3cyclictest9-21ksoftirqd/009:53:250
2098992620,3cyclictest9-21ksoftirqd/009:46:510
2098992619,4cyclictest9-21ksoftirqd/011:57:150
2098992619,4cyclictest9-21ksoftirqd/011:51:530
2098992619,4cyclictest9-21ksoftirqd/010:19:310
2098992619,4cyclictest9-21ksoftirqd/010:14:050
2120992520,3cyclictest41-21ksoftirqd/310:55:563
2120992520,3cyclictest41-21ksoftirqd/310:51:053
211199252,18cyclictest22400-21apt-get10:05:462
211199252,18cyclictest22400-21apt-get10:05:462
2111992521,3cyclictest33-21ksoftirqd/213:26:112
2111992520,3cyclictest33-21ksoftirqd/212:30:392
2111992520,3cyclictest33-21ksoftirqd/212:20:392
2111992519,3cyclictest33-21ksoftirqd/211:55:322
2111992519,3cyclictest33-21ksoftirqd/211:35:572
2111992519,3cyclictest33-21ksoftirqd/210:04:292
2111992519,3cyclictest33-21ksoftirqd/209:41:312
2111992518,4cyclictest33-21ksoftirqd/211:44:362
2111992518,4cyclictest33-21ksoftirqd/210:59:312
2111992518,4cyclictest33-21ksoftirqd/210:32:102
2111992518,4cyclictest33-21ksoftirqd/209:54:562
2098992519,4cyclictest9-21ksoftirqd/013:50:520
2098992519,3cyclictest9-21ksoftirqd/013:47:150
2098992519,3cyclictest9-21ksoftirqd/013:47:150
2098992519,3cyclictest9-21ksoftirqd/013:26:150
2098992519,3cyclictest9-21ksoftirqd/013:21:170
2098992519,3cyclictest9-21ksoftirqd/012:49:480
2098992519,3cyclictest9-21ksoftirqd/010:43:280
2098992518,4cyclictest9-21ksoftirqd/011:10:370
2111992419,3cyclictest33-21ksoftirqd/214:40:592
2111992419,3cyclictest33-21ksoftirqd/214:00:542
2111992419,3cyclictest33-21ksoftirqd/213:35:512
2111992418,3cyclictest33-21ksoftirqd/210:44:402
2111992417,4cyclictest33-21ksoftirqd/212:02:512
2111992417,4cyclictest33-21ksoftirqd/211:00:482
2111992417,4cyclictest33-21ksoftirqd/210:15:032
2098992418,4cyclictest9-21ksoftirqd/014:30:460
2098992418,3cyclictest9-21ksoftirqd/014:46:210
2098992418,3cyclictest9-21ksoftirqd/013:14:150
2098992418,3cyclictest9-21ksoftirqd/012:29:390
2098992418,3cyclictest9-21ksoftirqd/012:23:440
2098992418,3cyclictest9-21ksoftirqd/011:16:480
2098992418,3cyclictest9-21ksoftirqd/010:31:350
2098992418,3cyclictest9-21ksoftirqd/010:07:430
2098992418,3cyclictest9-21ksoftirqd/010:07:430
2098992417,4cyclictest19677-21snmp_o5powerctl13:56:090
2111992318,3cyclictest33-21ksoftirqd/214:31:122
2111992318,3cyclictest33-21ksoftirqd/212:50:542
2111992318,3cyclictest33-21ksoftirqd/209:30:492
2111992317,3cyclictest33-21ksoftirqd/210:36:402
2111992316,4cyclictest27806-21ps12:05:592
2098992317,3cyclictest9-21ksoftirqd/014:30:310
2098992317,3cyclictest9-21ksoftirqd/012:55:320
2098992317,3cyclictest9-21ksoftirqd/010:25:090
2098992317,3cyclictest9-21ksoftirqd/009:56:590
2098992316,4cyclictest18398-21grep14:35:550
2111992217,3cyclictest33-21ksoftirqd/214:21:082
2111992217,3cyclictest33-21ksoftirqd/213:01:002
2111992216,3cyclictest33-21ksoftirqd/210:52:072
2111992215,4cyclictest5386-21idleruntime-cro14:20:422
2111992215,4cyclictest33-21ksoftirqd/214:54:262
2111992215,4cyclictest10383-21sh13:05:452
2098992215,4cyclictest9-21ksoftirqd/009:27:080
209899221,3cyclictest8949-21ssh13:02:560
209899221,3cyclictest29503-21ssh12:07:370
209899221,18cyclictest5114-21irqstats10:35:550
209899221,18cyclictest1779-21runrttasks11:25:460
2111992117,3cyclictest33-21ksoftirqd/210:25:552
2111992116,3cyclictest33-21ksoftirqd/213:23:042
2111992116,3cyclictest33-21ksoftirqd/213:16:002
2111992115,3cyclictest33-21ksoftirqd/214:36:022
2111992115,3cyclictest33-21ksoftirqd/212:55:542
2111992115,3cyclictest33-21ksoftirqd/209:56:392
2098992115,4cyclictest8501-21head11:40:570
2098992114,4cyclictest9-21ksoftirqd/011:11:180
2098992114,4cyclictest9-21ksoftirqd/009:41:130
2098992114,4cyclictest4561-21ssh13:37:150
2098992114,4cyclictest29893-21cron14:10:410
209899211,3cyclictest32374-21ssh14:51:290
209899211,3cyclictest18591-21fw_packets12:36:000
209899211,17cyclictest22824-21perl14:40:560
209899211,17cyclictest13474-21ssh11:46:260
206552210,17sleep20-21swapper/211:56:052
2111992015,3cyclictest33-21ksoftirqd/211:20:312
2111992013,4cyclictest31013-21grep13:30:562
2111992013,4cyclictest26982-21basename14:46:002
2111992013,4cyclictest20750-21sh13:57:562
2098992014,4cyclictest187-21jbd2/sda1-809:30:350
2098992014,3cyclictest9-21ksoftirqd/014:17:360
2098992014,3cyclictest1659-21sh13:35:090
209899201,3cyclictest24984-21ssh14:03:240
2098992013,4cyclictest9-21ksoftirqd/010:50:460
2098992013,4cyclictest8093-21unixbench_singl13:41:160
2098992013,4cyclictest8093-21unixbench_singl13:41:160
2098992013,4cyclictest1517-21latency_hist10:30:370
209899201,17cyclictest15946-21ssh12:31:150
209899200,4cyclictest1431-21ssh11:31:060
2111991913,3cyclictest7494-21sed12:21:012
209899191,3cyclictest30996-21apt-get12:10:470
2098991913,3cyclictest19064-21sh13:15:560
2111991813,3cyclictest2485-21/usr/sbin/munin09:25:532
2098991811,4cyclictest9-21ksoftirqd/010:46:330
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional