You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-19 - 05:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri Sep 19, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1897799993,52cyclictest0-21swapper/018:52:440
223099650,9rtkit-daemon0-21swapper/318:46:053
223099650,8rtkit-daemon0-21swapper/322:17:493
223099650,8rtkit-daemon0-21swapper/321:57:203
223099650,8rtkit-daemon0-21swapper/321:21:593
223099650,8rtkit-daemon0-21swapper/320:12:173
223099650,8rtkit-daemon0-21swapper/320:12:173
223099640,8rtkit-daemon0-21swapper/319:02:423
223099640,12rtkit-daemon0-21swapper/322:11:053
223099640,12rtkit-daemon0-21swapper/319:11:043
223099640,11rtkit-daemon0-21swapper/318:09:443
223099630,9rtkit-daemon0-21swapper/322:45:263
223099630,8rtkit-daemon0-21swapper/321:49:433
223099630,8rtkit-daemon0-21swapper/318:31:063
223099630,3rtkit-daemon0-21swapper/320:19:093
223099630,11rtkit-daemon0-21swapper/321:44:583
223099630,11rtkit-daemon0-21swapper/321:44:583
260062623,50sleep10-21swapper/122:07:411
223099620,9rtkit-daemon0-21swapper/321:29:593
223099620,9rtkit-daemon0-21swapper/318:37:063
223099620,8rtkit-daemon0-21swapper/322:32:113
223099620,8rtkit-daemon0-21swapper/322:03:273
223099620,8rtkit-daemon0-21swapper/319:54:033
223099620,8rtkit-daemon0-21swapper/319:50:553
223099620,11rtkit-daemon0-21swapper/322:26:043
223099620,11rtkit-daemon0-21swapper/322:26:043
223099620,11rtkit-daemon0-21swapper/321:14:073
223099620,11rtkit-daemon0-21swapper/320:47:003
223099620,11rtkit-daemon0-21swapper/320:10:543
223099620,11rtkit-daemon0-21swapper/318:50:503
223099620,11rtkit-daemon0-21swapper/318:50:503
223099610,9rtkit-daemon0-21swapper/322:31:113
223099610,9rtkit-daemon0-21swapper/321:26:063
223099610,8rtkit-daemon0-21swapper/319:38:033
223099610,8rtkit-daemon0-21swapper/319:20:343
223099610,3rtkit-daemon0-21swapper/320:53:003
223099610,3rtkit-daemon0-21swapper/317:42:083
223099610,11rtkit-daemon0-21swapper/322:13:503
223099610,10rtkit-daemon0-21swapper/322:41:563
223099610,10rtkit-daemon0-21swapper/319:28:043
223099610,10rtkit-daemon0-21swapper/319:28:043
18981996140,12cyclictest25170-21needreboot17:32:453
1898199614,40cyclictest0-21swapper/320:57:383
1898199614,40cyclictest0-21swapper/320:57:383
223099600,7rtkit-daemon0-21swapper/322:48:563
223099600,7rtkit-daemon0-21swapper/321:07:223
223099600,7rtkit-daemon0-21swapper/319:00:273
17482603,50sleep00-21swapper/020:12:230
17482603,50sleep00-21swapper/020:12:230
223099590,7rtkit-daemon0-21swapper/320:30:093
223099590,4rtkit-daemon2229-21rtkit-daemon18:00:373
223099590,2rtkit-daemon0-21swapper/318:38:363
18977995919,22cyclictest17713-21latency_hist18:27:140
152382593,49sleep00-21swapper/021:47:250
1415925910,8sleep20-21swapper/221:42:432
1415925910,8sleep20-21swapper/221:42:432
223099580,4rtkit-daemon2229-21rtkit-daemon17:56:223
223099580,2rtkit-daemon0-21swapper/320:42:013
18981995837,13cyclictest14925-21unixbench_singl18:17:503
1897999584,31cyclictest0-21swapper/117:52:151
223099570,2rtkit-daemon0-21swapper/321:55:353
204702574,45sleep00-21swapper/021:57:280
101372570,7sleep11897999cyclictest20:27:351
3422563,46sleep00-21swapper/017:47:520
223099560,4rtkit-daemon2229-21rtkit-daemon19:58:403
223099560,4rtkit-daemon2229-21rtkit-daemon18:05:073
223099560,4rtkit-daemon2229-21rtkit-daemon18:05:073
18981995636,12cyclictest26465-21grep21:02:283
1897999564,32cyclictest0-21swapper/117:47:151
18979995639,11cyclictest0-21swapper/118:42:431
1898199553,11cyclictest0-21swapper/321:32:433
18980995517,23cyclictest0-21swapper/217:54:362
18979995535,12cyclictest1265-21runrttasks20:52:211
1897799553,46cyclictest0-21swapper/021:07:350
1897799553,46cyclictest0-21swapper/019:52:470
324942543,43sleep10-21swapper/121:16:021
223099540,6rtkit-daemon0-21swapper/322:39:342
1898199545,28cyclictest0-21swapper/321:37:393
18981995421,13cyclictest1160-21snmpd20:48:483
18980995441,8cyclictest19637-21munin-node21:57:202
18980995415,32cyclictest0-21swapper/221:47:342
1897999545,28cyclictest0-21swapper/120:37:451
1897999544,32cyclictest0-21swapper/119:57:441
18979995421,14cyclictest0-21swapper/120:17:291
18979995421,13cyclictest0-21swapper/121:07:381
1897799544,44cyclictest0-21swapper/020:07:400
1897799544,44cyclictest0-21swapper/019:32:230
18977995423,24cyclictest0-21swapper/020:22:380
137042543,44sleep20-21swapper/220:37:202
223099530,5rtkit-daemon2229-21rtkit-daemon18:27:133
223099530,5rtkit-daemon2229-21rtkit-daemon17:27:312
223099530,5rtkit-daemon2229-21rtkit-daemon17:22:392
1898099534,29cyclictest0-21swapper/217:40:042
1898099534,25cyclictest1265-21runrttasks21:27:242
18980995336,10cyclictest28036-21df18:47:342
18980995336,10cyclictest28036-21df18:47:342
18980995326,11cyclictest12321-21crond19:27:112
1897999536,35cyclictest0-21swapper/119:19:521
1897999535,28cyclictest0-21swapper/118:17:341
1897999535,27cyclictest0-21swapper/119:44:051
1897999534,30cyclictest0-21swapper/120:02:311
1897999534,28cyclictest0-21swapper/121:52:061
1897999534,28cyclictest0-21swapper/119:52:111
18979995334,13cyclictest0-21swapper/119:27:311
18979995334,13cyclictest0-21swapper/119:27:311
18979995333,13cyclictest0-21swapper/118:52:131
18979995333,13cyclictest0-21swapper/118:52:131
1897799533,44cyclictest0-21swapper/020:41:080
96132523,42sleep10-21swapper/121:34:071
35972522,9sleep20-21swapper/222:28:542
223099520,4rtkit-daemon2229-21rtkit-daemon17:48:152
1898199525,27cyclictest0-21swapper/317:22:403
1898199524,29cyclictest0-21swapper/318:52:453
1898199524,28cyclictest0-21swapper/319:22:393
18981995223,13cyclictest0-21swapper/320:32:203
1898099524,29cyclictest0-21swapper/219:27:502
1898099524,29cyclictest0-21swapper/219:27:502
1897999524,41cyclictest0-21swapper/118:57:471
1897999524,29cyclictest0-21swapper/118:52:511
1897999524,29cyclictest0-21swapper/117:27:291
1897999524,27cyclictest0-21swapper/118:14:551
18979995234,14cyclictest0-21swapper/121:22:071
18979995231,14cyclictest0-21swapper/122:22:171
18979995231,14cyclictest0-21swapper/122:22:171
1897999523,29cyclictest0-21swapper/118:29:581
1897999523,23cyclictest0-21swapper/122:17:051
18979995220,26cyclictest19910-21sendmail_mailqu20:47:421
18979995216,14cyclictest0-21swapper/118:07:491
1897799525,39cyclictest0-21swapper/018:47:290
1897799525,39cyclictest0-21swapper/018:47:290
1897799523,43cyclictest0-21swapper/022:32:340
1897799523,43cyclictest0-21swapper/021:52:320
133952522,43sleep00-21swapper/020:36:140
10382522,43sleep00-21swapper/022:23:320
10382522,43sleep00-21swapper/022:23:320
83842512,9sleep20-21swapper/220:23:052
287262512,9sleep00-21swapper/022:13:570
1898199514,28cyclictest0-21swapper/318:12:273
18981995121,12cyclictest0-21swapper/320:07:103
18981995119,13cyclictest0-21swapper/317:47:293
1898099514,30cyclictest0-21swapper/218:32:332
1898099514,29cyclictest0-21swapper/222:47:192
1898099514,29cyclictest0-21swapper/219:02:292
1898099514,28cyclictest0-21swapper/220:57:192
1898099514,28cyclictest0-21swapper/220:57:192
1898099513,27cyclictest0-21swapper/222:12:292
18980995121,13cyclictest0-21swapper/219:52:292
1897999515,27cyclictest0-21swapper/118:22:471
1897999514,28cyclictest0-21swapper/117:42:151
1897999514,27cyclictest0-21swapper/122:02:251
18979995132,14cyclictest0-21swapper/119:22:251
18979995132,11cyclictest22011-21unixbench-2d18:32:501
18979995123,13cyclictest0-21swapper/120:57:391
18979995123,13cyclictest0-21swapper/120:57:391
18979995122,13cyclictest0-21swapper/119:37:391
18979995117,13cyclictest0-21swapper/117:22:521
18979995116,10cyclictest0-21swapper/122:27:271
1897799514,40cyclictest0-21swapper/021:42:260
1897799514,40cyclictest0-21swapper/021:42:260
1897799513,43cyclictest0-21swapper/018:42:570
1897799513,42cyclictest0-21swapper/021:17:340
1897799513,42cyclictest0-21swapper/021:12:270
1897799513,42cyclictest0-21swapper/020:47:230
1897799513,41cyclictest0-21swapper/019:22:370
1897799513,13cyclictest0-21swapper/019:27:340
1897799513,13cyclictest0-21swapper/019:27:340
18977995126,19cyclictest0-21swapper/019:47:420
117882512,9sleep00-21swapper/018:12:390
48392502,41sleep00-21swapper/019:08:300
1898199504,27cyclictest0-21swapper/319:42:463
1898199503,28cyclictest0-21swapper/317:47:163
1898099509,25cyclictest0-21swapper/218:42:262
1898099504,29cyclictest0-21swapper/221:07:412
1898099504,29cyclictest0-21swapper/217:42:332
1898099504,28cyclictest0-21swapper/220:42:242
1898099504,28cyclictest0-21swapper/220:12:382
1898099504,28cyclictest0-21swapper/220:12:382
1898099504,28cyclictest0-21swapper/220:07:242
1898099503,29cyclictest0-21swapper/218:57:272
1898099503,28cyclictest0-21swapper/222:02:212
1898099503,12cyclictest0-21swapper/218:27:262
1898099502,42cyclictest0-21swapper/218:52:272
18980995019,13cyclictest0-21swapper/221:37:242
1897999504,27cyclictest0-21swapper/122:37:361
18979995033,11cyclictest3786-21fgrep19:02:431
18979995031,14cyclictest0-21swapper/122:42:171
18979995031,13cyclictest0-21swapper/117:35:111
18979995030,14cyclictest0-21swapper/121:27:201
1897999503,30cyclictest0-21swapper/119:52:241
18979995029,14cyclictest0-21swapper/122:32:391
1897799506,39cyclictest0-21swapper/019:42:510
1897799503,41cyclictest0-21swapper/020:52:290
1897799503,41cyclictest0-21swapper/018:57:380
1897799503,41cyclictest0-21swapper/018:27:390
1897799503,41cyclictest0-21swapper/017:47:150
1897799503,40cyclictest0-21swapper/018:17:300
1897799503,13cyclictest0-21swapper/017:22:270
18977995023,9cyclictest29029-21crond20:02:090
59872493,39sleep10-21swapper/118:02:201
59872493,39sleep10-21swapper/118:02:201
49222492,41sleep00-21swapper/021:25:120
281932492,41sleep00-21swapper/017:38:200
223099490,5rtkit-daemon2229-21rtkit-daemon17:32:382
1898099494,38cyclictest0-21swapper/218:37:252
1898099494,27cyclictest0-21swapper/222:17:192
1898099494,27cyclictest0-21swapper/219:12:292
18980994918,14cyclictest0-21swapper/221:32:382
1897999497,33cyclictest0-21swapper/122:19:531
1897999496,34cyclictest0-21swapper/121:02:211
1897999494,28cyclictest0-21swapper/120:07:371
1897999494,26cyclictest0-21swapper/122:49:361
1897999493,26cyclictest0-21swapper/121:39:231
18979994928,14cyclictest0-21swapper/119:12:121
18979994921,13cyclictest0-21swapper/120:42:431
18979994920,12cyclictest0-21swapper/118:38:571
1897799495,37cyclictest0-21swapper/021:32:260
1897799494,39cyclictest0-21swapper/020:04:080
1897799494,38cyclictest0-21swapper/020:27:220
1897799494,15cyclictest0-21swapper/021:27:350
18977994919,14cyclictest0-21swapper/019:07:130
169932493,40sleep10-21swapper/119:35:561
119232492,40sleep00-21swapper/021:38:100
223099480,5rtkit-daemon2229-21rtkit-daemon19:32:333
1898199485,26cyclictest0-21swapper/317:27:413
1898099485,24cyclictest0-21swapper/219:17:332
1898099484,38cyclictest0-21swapper/220:32:352
1898099484,29cyclictest0-21swapper/218:02:472
1898099484,29cyclictest0-21swapper/218:02:472
1898099484,28cyclictest0-21swapper/218:17:512
1898099484,27cyclictest0-21swapper/221:18:522
1898099483,39cyclictest18481-21munin-node20:47:462
1898099483,38cyclictest0-21swapper/221:02:292
1898099483,28cyclictest0-21swapper/221:12:332
1898099483,28cyclictest0-21swapper/220:17:332
1897999484,38cyclictest0-21swapper/121:52:321
1897999484,38cyclictest0-21swapper/117:52:471
1897999484,35cyclictest0-21swapper/121:22:211
1897999484,15cyclictest0-21swapper/120:22:401
1897999484,14cyclictest0-21swapper/119:12:371
18979994831,10cyclictest20977-21chrt21:57:361
18979994827,15cyclictest0-21swapper/117:57:291
1897799483,40cyclictest0-21swapper/022:04:280
1897799483,39cyclictest0-21swapper/020:44:150
18981994731,8cyclictest6287-21grep19:12:283
18981994719,12cyclictest0-21swapper/320:24:113
1898099474,37cyclictest0-21swapper/218:08:382
1898099474,28cyclictest0-21swapper/222:42:342
1898099474,27cyclictest0-21swapper/219:49:052
1898099474,27cyclictest0-21swapper/219:08:592
1898099474,27cyclictest0-21swapper/218:22:412
1898099474,13cyclictest0-21swapper/221:52:272
18980994730,10cyclictest32343-21tune2fs22:22:232
18980994730,10cyclictest32343-21tune2fs22:22:232
1898099473,27cyclictest0-21swapper/218:12:392
1898099473,27cyclictest0-21swapper/217:57:282
1898099473,22cyclictest0-21swapper/222:35:282
18980994716,18cyclictest26978-21kworker/2:120:02:242
1897999474,37cyclictest0-21swapper/120:17:091
1897999474,37cyclictest0-21swapper/120:17:091
1897999473,23cyclictest0-21swapper/120:32:111
18979994729,12cyclictest13114-21cut21:42:241
18979994729,12cyclictest13114-21cut21:42:241
1897799475,36cyclictest0-21swapper/022:17:250
1897799474,37cyclictest0-21swapper/022:07:380
1897799472,38cyclictest5386-21aten2.4-expect19:12:190
108652472,38sleep00-21swapper/022:45:130
41352462,38sleep20-21swapper/221:22:362
251582462,9sleep00-21swapper/020:58:590
251582462,9sleep00-21swapper/020:58:590
1898099464,13cyclictest0-21swapper/219:59:552
1898099463,28cyclictest0-21swapper/219:42:342
1897799463,38cyclictest0-21swapper/022:29:420
1897799463,37cyclictest0-21swapper/022:47:140
1897799463,37cyclictest0-21swapper/019:19:560
1897799463,37cyclictest0-21swapper/018:02:250
1897799463,37cyclictest0-21swapper/018:02:250
18977994620,10cyclictest0-21swapper/021:02:290
186672464,6sleep00-21swapper/017:18:460
186672464,6sleep00-21swapper/017:18:460
223099450,5rtkit-daemon2229-21rtkit-daemon17:17:392
223099450,5rtkit-daemon2229-21rtkit-daemon17:17:392
216652452,37sleep00-21swapper/018:32:460
1898099453,38cyclictest0-21swapper/222:11:422
1898099453,35cyclictest0-21swapper/219:32:292
1897799459,31cyclictest41ktimersoftd/018:42:130
1897799454,35cyclictest0-21swapper/019:37:260
1897799453,38cyclictest0-21swapper/018:10:270
1897799453,37cyclictest0-21swapper/017:52:190
1897799453,37cyclictest0-21swapper/017:27:440
1897799453,36cyclictest0-21swapper/022:37:180
109852452,9sleep20-21swapper/220:30:562
54832442,37sleep00-21swapper/017:58:440
1898099444,23cyclictest0-21swapper/219:37:272
1898099443,34cyclictest21796-21grep20:52:302
1897799445,32cyclictest0-21swapper/017:32:350
1897799443,35cyclictest0-21swapper/020:17:260
18979994321,15cyclictest0-21swapper/117:22:171
18979994321,15cyclictest0-21swapper/117:22:171
1898199384,26cyclictest19026-21latency_hist17:22:173
1898199384,26cyclictest19026-21latency_hist17:22:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional