You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-19 - 20:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot3.osadl.org (updated Sat Apr 19, 2025 12:45:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137191208173,23phc2sys0-21swapper/307:06:063
57132206172,22sleep00-21swapper/007:08:510
55652203170,22sleep20-21swapper/207:06:562
54752203170,22sleep10-21swapper/107:05:461
137191163125,28phc2sys0-21swapper/307:10:003
709321320,6sleep3609699cyclictest09:30:153
136991750,1ptp4l391rcuc/309:00:283
6094996231,4cyclictest25-21ksoftirqd/108:05:001
301082600,2sleep10-21swapper/111:50:171
301082600,2sleep10-21swapper/111:50:171
6094995928,4cyclictest25-21ksoftirqd/111:40:151
6094995828,4cyclictest25-21ksoftirqd/107:10:291
6094995816,4cyclictest25-21ksoftirqd/109:45:031
609599570,55cyclictest18939-21kworker/2:007:10:272
6094995729,3cyclictest25-21ksoftirqd/108:15:241
6094995729,3cyclictest25-21ksoftirqd/108:15:231
6094995728,4cyclictest25-21ksoftirqd/108:10:191
6094995726,3cyclictest25-21ksoftirqd/109:10:281
6093995728,3cyclictest9-21ksoftirqd/012:20:260
6094995626,4cyclictest25-21ksoftirqd/107:40:151
6094995625,3cyclictest25-21ksoftirqd/111:50:011
6094995528,4cyclictest25-21ksoftirqd/110:10:171
6094995527,3cyclictest25-21ksoftirqd/107:35:161
6094995527,3cyclictest25-21ksoftirqd/107:25:261
6094995526,3cyclictest25-21ksoftirqd/109:45:001
6094995524,4cyclictest25-21ksoftirqd/110:30:091
6094995524,4cyclictest25-21ksoftirqd/110:30:091
6094995524,4cyclictest25-21ksoftirqd/109:20:241
6093995526,4cyclictest9-21ksoftirqd/012:00:150
210082550,3sleep321011-21unixbench_multi10:00:313
6094995426,4cyclictest25-21ksoftirqd/110:20:221
6094995425,4cyclictest25-21ksoftirqd/108:30:301
6094995424,4cyclictest25-21ksoftirqd/109:50:221
6094995422,4cyclictest25-21ksoftirqd/111:15:281
609699534,16cyclictest21538-21/usr/sbin/munin08:50:183
6094995327,4cyclictest25-21ksoftirqd/112:00:251
6094995225,4cyclictest25-21ksoftirqd/110:00:241
6094995225,4cyclictest25-21ksoftirqd/107:20:191
6094995224,4cyclictest25-21ksoftirqd/111:00:201
6094995224,3cyclictest25-21ksoftirqd/108:00:001
6094995220,3cyclictest25-21ksoftirqd/109:35:291
609699512,10cyclictest28723-21cpu09:05:173
6094995124,3cyclictest25-21ksoftirqd/111:20:141
6094995122,3cyclictest25-21ksoftirqd/112:15:141
6093995115,5cyclictest9-21ksoftirqd/007:55:230
6094995022,4cyclictest25-21ksoftirqd/109:30:091
6094995021,4cyclictest25-21ksoftirqd/110:15:261
6094995019,4cyclictest25-21ksoftirqd/109:55:191
6094995019,3cyclictest25-21ksoftirqd/111:10:181
6094995018,4cyclictest25-21ksoftirqd/108:50:011
6093995027,2cyclictest9-21ksoftirqd/008:25:240
6093995021,11cyclictest9-21ksoftirqd/011:55:200
6093995018,3cyclictest9-21ksoftirqd/009:50:300
106192500,2sleep30-21swapper/307:20:003
6094994922,4cyclictest25-21ksoftirqd/107:15:241
6094994919,3cyclictest25-21ksoftirqd/111:30:231
609399499,9cyclictest9-21ksoftirqd/008:40:010
6093994920,4cyclictest9-21ksoftirqd/007:15:180
6093994919,4cyclictest9-21ksoftirqd/010:23:380
6093994919,3cyclictest9-21ksoftirqd/011:27:130
6093994917,5cyclictest9-21ksoftirqd/011:15:290
174042490,1sleep10-21swapper/107:30:291
6094994818,4cyclictest25-21ksoftirqd/110:50:121
6094994818,4cyclictest25-21ksoftirqd/110:40:231
6094994817,4cyclictest25-21ksoftirqd/111:40:011
6093994833,12cyclictest9-21ksoftirqd/010:20:000
6093994818,3cyclictest9-21ksoftirqd/008:03:080
609599473,43cyclictest412-21kworker/2:009:30:272
6094994721,4cyclictest25-21ksoftirqd/109:15:261
6094994717,4cyclictest25-21ksoftirqd/108:55:301
6094994717,3cyclictest25-21ksoftirqd/108:40:281
6093994716,4cyclictest9-21ksoftirqd/010:35:250
6093994716,4cyclictest9-21ksoftirqd/008:35:140
6093994713,4cyclictest9-21ksoftirqd/010:10:210
6094994629,4cyclictest25-21ksoftirqd/112:35:191
6094994618,8cyclictest25-21ksoftirqd/109:00:161
6094994615,4cyclictest25-21ksoftirqd/112:10:161
6093994619,3cyclictest9-21ksoftirqd/011:10:100
6093994618,4cyclictest9-21ksoftirqd/012:30:200
6093994614,5cyclictest9-21ksoftirqd/009:00:190
6094994531,4cyclictest25-21ksoftirqd/112:30:081
6094994531,3cyclictest25-21ksoftirqd/109:10:001
6094994517,4cyclictest25-21ksoftirqd/108:35:231
6094994516,4cyclictest25-21ksoftirqd/110:35:241
6094994515,4cyclictest25-21ksoftirqd/107:45:131
609399457,2cyclictest121rcu_preempt07:30:300
6093994515,4cyclictest9-21ksoftirqd/007:10:300
609699443,8cyclictest26273-21mailstats10:15:243
6094994415,4cyclictest25-21ksoftirqd/111:28:291
6094994415,4cyclictest25-21ksoftirqd/108:09:401
6094994413,4cyclictest25-21ksoftirqd/112:20:251
6094994410,4cyclictest25-21ksoftirqd/111:06:021
6093994432,4cyclictest9-21ksoftirqd/010:30:010
6093994426,3cyclictest9-21ksoftirqd/009:50:010
6093994414,9cyclictest9-21ksoftirqd/009:05:230
6093994413,9cyclictest9-21ksoftirqd/007:50:000
6093994411,4cyclictest9-21ksoftirqd/009:20:270
136991440,0ptp4l401ktimersoftd/308:10:443
609699434,8cyclictest6239-21diskstats10:50:103
609699434,7cyclictest1892-21hddtemp_smartct12:00:183
609699433,8cyclictest1410-21diskstats09:15:173
609499436,8cyclictest25-21ksoftirqd/107:50:211
6094994328,3cyclictest25-21ksoftirqd/108:25:191
6094994327,4cyclictest25-21ksoftirqd/108:50:101
6094994315,3cyclictest25-21ksoftirqd/109:30:001
609399439,4cyclictest9-21ksoftirqd/007:35:140
6093994333,2cyclictest9-21ksoftirqd/011:00:160
6093994329,3cyclictest9-21ksoftirqd/008:50:250
6093994320,9cyclictest9-21ksoftirqd/009:30:110
6093994313,4cyclictest9-21ksoftirqd/012:10:110
6093994313,4cyclictest9-21ksoftirqd/007:50:260
136991430,0ptp4l401ktimersoftd/310:56:453
136991430,0ptp4l401ktimersoftd/309:35:273
609699423,7cyclictest31999-21irqstats09:10:233
609699423,7cyclictest16187-21diskstats07:30:173
609699423,10cyclictest17658-21memory08:40:233
609399426,8cyclictest9-21ksoftirqd/008:10:280
609399425,3cyclictest121rcu_preempt08:31:130
609399424,3cyclictest121rcu_preempt10:00:010
6093994211,5cyclictest9-21ksoftirqd/008:20:180
136991420,0ptp4l401ktimersoftd/308:48:193
136991420,0ptp4l401ktimersoftd/308:23:363
609699414,7cyclictest5167-21diskstats08:15:163
609699414,7cyclictest5167-21diskstats08:15:163
609699413,7cyclictest809-21diskstats10:35:173
609699413,7cyclictest5433-21memory12:10:173
609599414,36cyclictest412-21kworker/2:010:18:282
609499414,7cyclictest25-21ksoftirqd/110:50:001
6094994112,4cyclictest25-21ksoftirqd/108:20:301
609399419,10cyclictest9-21ksoftirqd/011:20:150
609399415,9cyclictest9-21ksoftirqd/011:40:170
6093994127,4cyclictest9-21ksoftirqd/010:45:010
6093994126,4cyclictest9-21ksoftirqd/012:15:210
6093994122,3cyclictest9-21ksoftirqd/009:43:530
6093994121,9cyclictest9-21ksoftirqd/009:15:150
6093994110,4cyclictest9-21ksoftirqd/011:35:130
6093994110,10cyclictest9-21ksoftirqd/008:05:260
609699403,7cyclictest7163-21diskstats12:15:163
609599403,35cyclictest412-21kworker/2:010:14:202
609599401,37cyclictest11998-21kworker/2:108:45:272
6094994026,4cyclictest25-21ksoftirqd/110:55:281
6094994011,3cyclictest25-21ksoftirqd/111:55:131
6094994010,3cyclictest25-21ksoftirqd/110:30:011
609399409,10cyclictest9-21ksoftirqd/008:15:120
609399409,10cyclictest9-21ksoftirqd/008:15:120
609399404,3cyclictest121rcu_preempt11:07:540
609399403,3cyclictest121rcu_preempt07:25:210
609399401,2cyclictest121rcu_preempt12:39:590
609599392,24cyclictest412-21kworker/2:010:55:322
609599391,36cyclictest412-21kworker/2:010:48:362
609399395,9cyclictest9-21ksoftirqd/011:50:080
609399395,9cyclictest9-21ksoftirqd/011:50:080
609399395,8cyclictest9-21ksoftirqd/009:10:240
6093993934,3cyclictest9-21ksoftirqd/010:05:000
609399393,3cyclictest121rcu_preempt10:50:230
6093993933,3cyclictest9-21ksoftirqd/010:09:590
6093993924,4cyclictest9-21ksoftirqd/007:20:230
59298390,2rtkit-daemon0-21swapper/008:46:410
609599387,29cyclictest11998-21kworker/2:108:30:032
609599387,16cyclictest412-21kworker/2:009:29:422
609599383,33cyclictest12103-21kworker/2:112:31:152
609599381,23cyclictest12578-21kworker/2:112:00:312
6094993821,4cyclictest25-21ksoftirqd/110:10:001
6093993825,3cyclictest9-21ksoftirqd/011:00:010
609599378,28cyclictest412-21kworker/2:010:37:592
609599378,27cyclictest0-21swapper/211:55:272
609599377,29cyclictest11998-21kworker/2:108:20:512
609599377,28cyclictest12578-21kworker/2:111:05:312
609599377,17cyclictest412-21kworker/2:010:45:002
609599372,33cyclictest11998-21kworker/2:108:17:152
609599372,33cyclictest11998-21kworker/2:108:17:152
609599372,32cyclictest11112-21kworker/2:212:26:162
609599371,35cyclictest412-21kworker/2:009:15:352
609599371,35cyclictest11998-21kworker/2:108:10:392
609599371,34cyclictest11998-21kworker/2:107:28:112
6093993724,4cyclictest9-21ksoftirqd/011:30:140
6093993723,4cyclictest9-21ksoftirqd/009:35:260
6093993715,11cyclictest9-21ksoftirqd/008:55:200
136991370,0ptp4l401ktimersoftd/310:24:273
136991370,0ptp4l401ktimersoftd/309:40:233
132691370,1getstats0-21swapper/308:35:283
609599367,28cyclictest412-21kworker/2:011:02:152
609599367,28cyclictest412-21kworker/2:009:57:022
609599367,28cyclictest0-21swapper/211:35:262
609599366,29cyclictest12578-21kworker/2:112:12:272
609599366,28cyclictest12578-21kworker/2:112:16:592
609599366,28cyclictest12578-21kworker/2:111:12:032
609599366,28cyclictest11998-21kworker/2:109:08:432
609599363,32cyclictest11998-21kworker/2:107:20:592
609599363,31cyclictest11998-21kworker/2:107:51:552
6095993630,4cyclictest33-21ksoftirqd/211:30:322
609599362,33cyclictest12578-21kworker/2:112:20:432
609599362,33cyclictest11998-21kworker/2:108:36:312
609599362,33cyclictest11998-21kworker/2:108:03:512
609599361,34cyclictest11998-21kworker/2:107:47:232
609599361,33cyclictest412-21kworker/2:009:14:392
609599361,33cyclictest11998-21kworker/2:108:05:112
609599360,32cyclictest30226-21apt-key10:30:002
609399365,2cyclictest121rcu_preempt10:30:140
609399365,2cyclictest121rcu_preempt10:30:140
609399363,8cyclictest9-21ksoftirqd/012:10:000
6093993622,2cyclictest9-21ksoftirqd/012:25:030
6093993619,4cyclictest9-21ksoftirqd/007:40:150
6096993528,4cyclictest41-21ksoftirqd/311:03:463
609699352,20cyclictest0-21swapper/307:35:153
609599356,28cyclictest11998-21kworker/2:108:25:502
609599353,30cyclictest412-21kworker/2:009:53:472
609599353,30cyclictest12578-21kworker/2:111:53:162
609599353,30cyclictest12578-21kworker/2:111:53:162
609599353,30cyclictest11998-21kworker/2:107:55:552
6095993529,4cyclictest33-21ksoftirqd/208:52:302
6095993529,4cyclictest33-21ksoftirqd/207:15:422
609599352,32cyclictest11998-21kworker/2:108:40:312
609599352,32cyclictest11998-21kworker/2:107:40:512
609599351,33cyclictest412-21kworker/2:009:23:352
609599351,33cyclictest12578-21kworker/2:111:15:482
609599351,32cyclictest412-21kworker/2:009:46:192
609599351,31cyclictest12578-21kworker/2:112:05:112
609599351,20cyclictest412-21kworker/2:009:42:552
609599350,34cyclictest412-21kworker/2:010:50:562
609599350,22cyclictest412-21kworker/2:009:35:112
609399353,4cyclictest121rcu_preempt10:50:010
6093993529,3cyclictest9-21ksoftirqd/011:50:000
6093993522,3cyclictest9-21ksoftirqd/009:29:590
132691350,1getstats0-21swapper/308:00:283
6096993429,3cyclictest41-21ksoftirqd/307:41:353
6096993428,4cyclictest41-21ksoftirqd/311:07:473
609599344,28cyclictest412-21kworker/2:010:08:392
609599344,28cyclictest412-21kworker/2:010:00:062
6095993428,4cyclictest33-21ksoftirqd/207:34:402
609599342,30cyclictest11998-21kworker/2:108:58:022
609599342,30cyclictest11998-21kworker/2:107:35:072
6094993430,3cyclictest25-21ksoftirqd/112:10:011
6094993422,3cyclictest25-21ksoftirqd/112:25:581
6096993327,4cyclictest41-21ksoftirqd/310:33:213
6096993327,4cyclictest41-21ksoftirqd/310:33:213
6096993327,4cyclictest41-21ksoftirqd/308:59:543
6096993327,4cyclictest41-21ksoftirqd/307:58:523
6096993326,4cyclictest41-21ksoftirqd/311:11:163
609599336,26cyclictest12578-21kworker/2:111:27:402
609599332,7cyclictest11998-21kworker/2:109:00:072
6095993327,3cyclictest33-21ksoftirqd/210:31:092
6095993327,3cyclictest33-21ksoftirqd/210:31:092
609599332,29cyclictest12578-21kworker/2:111:44:112
6096993226,4cyclictest41-21ksoftirqd/312:25:573
6096993226,4cyclictest41-21ksoftirqd/310:29:083
6096993226,4cyclictest41-21ksoftirqd/309:55:343
6096993226,4cyclictest41-21ksoftirqd/309:54:103
6096993226,4cyclictest41-21ksoftirqd/307:29:553
609599326,25cyclictest12578-21kworker/2:111:21:482
609599325,25cyclictest412-21kworker/2:010:23:562
609599324,26cyclictest12103-21kworker/2:112:38:272
609599322,29cyclictest12578-21kworker/2:111:45:392
609699313,15cyclictest26022-21apt-get11:40:143
6096993126,3cyclictest41-21ksoftirqd/312:37:343
6096993126,3cyclictest41-21ksoftirqd/312:24:133
6096993025,3cyclictest41-21ksoftirqd/308:29:193
6096993024,4cyclictest41-21ksoftirqd/309:25:413
6096992924,3cyclictest41-21ksoftirqd/312:30:183
6096992924,3cyclictest41-21ksoftirqd/311:26:423
6096992924,3cyclictest41-21ksoftirqd/310:14:103
6096992924,3cyclictest41-21ksoftirqd/309:48:563
6096992923,4cyclictest41-21ksoftirqd/311:56:583
6096992923,4cyclictest41-21ksoftirqd/311:30:383
6096992923,4cyclictest41-21ksoftirqd/307:47:203
6096992923,4cyclictest41-21ksoftirqd/307:23:293
6096992822,4cyclictest41-21ksoftirqd/311:50:073
6096992822,4cyclictest41-21ksoftirqd/311:50:073
6096992822,4cyclictest41-21ksoftirqd/310:47:483
609699282,17cyclictest0-21swapper/311:35:203
6096992722,3cyclictest41-21ksoftirqd/309:20:473
6096992722,3cyclictest41-21ksoftirqd/308:31:453
6096992621,3cyclictest41-21ksoftirqd/311:23:073
136991260,1ptp4l401ktimersoftd/308:05:153
136991260,0ptp4l401ktimersoftd/311:15:203
6096992419,3cyclictest41-21ksoftirqd/312:06:093
6096992419,3cyclictest41-21ksoftirqd/311:45:093
136991230,0ptp4l401ktimersoftd/310:40:253
136991230,0ptp4l401ktimersoftd/310:06:403
136991230,0ptp4l401ktimersoftd/307:50:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional