You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 23:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackfslot4.osadl.org (updated Sun Nov 23, 2025 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
778622820,6sleep1121rcu_preempt07:08:451
710422640,2sleep20-21swapper/207:05:292
767322460,2sleep30-21swapper/307:07:193
796298203197,3cyclictest1050ksoftirqd/011:57:000
796298118106,9cyclictest10-21ksoftirqd/007:17:190
2737921040,2sleep20-21swapper/210:28:412
79679810396,3cyclictest9561-21kworker/u8:2507:17:191
79629810292,7cyclictest1050ksoftirqd/008:32:050
79629810088,9cyclictest10-21ksoftirqd/007:41:580
7967988983,3cyclictest5619-21kworker/u8:2908:32:041
240742870,2sleep10-21swapper/110:20:401
7967988679,4cyclictest19094-21kworker/u8:3007:41:581
7962987873,3cyclictest1050ksoftirqd/009:17:070
7972987769,4cyclictest5602-21kworker/u8:908:32:043
7962987767,7cyclictest10-21ksoftirqd/007:12:120
7962987666,7cyclictest10-21ksoftirqd/011:37:250
7972987065,3cyclictest19098-21kworker/u8:3407:41:583
7967987063,4cyclictest23112-21kworker/u8:109:17:081
7962986455,6cyclictest10-21ksoftirqd/008:26:570
7962986256,3cyclictest1050ksoftirqd/008:21:500
290702610,5sleep1191ksoftirqd/111:40:121
7962985948,8cyclictest10-21ksoftirqd/008:57:520
7972985650,3cyclictest23117-21kworker/u8:609:17:073
30122540,2sleep11983-21bootmenu10:45:201
7967985246,4cyclictest28601-21kworker/u8:1208:26:581
7962985241,7cyclictest10-21ksoftirqd/009:47:020
7972984943,3cyclictest25737-21kworker/u8:011:37:253
7962984938,8cyclictest10-21ksoftirqd/010:51:290
50082490,3sleep25000-21ssh09:40:452
7969984638,5cyclictest3028-21kworker/u8:4511:57:002
191452450,2sleep30-21swapper/311:19:353
7967984338,3cyclictest15253-21kworker/u8:4708:57:531
796998421,26cyclictest3057-21memory08:20:252
327252420,2sleep10-21swapper/108:15:021
327252420,2sleep10-21swapper/108:15:011
7972984033,4cyclictest32411-21kworker/u8:2308:21:503
796998401,28cyclictest5124-21ntp_states08:25:372
796998392,21cyclictest25414-21/usr/sbin/munin07:55:212
796998391,20cyclictest30518-21df_inode10:35:212
7962983930,7cyclictest10-21ksoftirqd/007:21:290
312372390,2sleep131212-21ssh10:35:391
7962983831,4cyclictest1050ksoftirqd/008:42:190
7972983732,3cyclictest3729-21kworker/u8:1808:26:573
796998371,20cyclictest12444-21df07:20:342
796998371,18cyclictest9745-21ntpq12:05:302
796998365,16cyclictest21086-21kworker/u8:1011:30:272
796998361,18cyclictest10389-21hddtemp_smartct08:40:312
796998361,17cyclictest6385-21diskstats08:30:212
84272350,2chrt0-21swapper/210:55:382
796998351,18cyclictest9665-21ntp_states09:50:462
796998351,18cyclictest21855-21ntp_states12:30:402
271662350,2sleep10-21swapper/109:20:261
271662350,2sleep10-21swapper/109:20:251
796998341,18cyclictest32658-21cat08:15:002
796998341,18cyclictest32658-21cat08:15:002
796998341,17cyclictest23637-21hddtemp_smartct12:35:222
796998341,14cyclictest13998-21df12:15:202
121642340,2sleep30-21swapper/307:20:053
796998331,18cyclictest17400-21hddtemp_smartct11:15:222
796998331,17cyclictest29796-21ntp_states09:25:372
796998331,16cyclictest9039-21ld07:10:362
797298322,6cyclictest121rcu_preempt08:55:133
796998321,17cyclictest10326-21diskstats07:15:212
796998321,14cyclictest24248-21df_inode09:15:202
7967983214,3cyclictest19-21ksoftirqd/107:55:361
796798321,3cyclictest121rcu_preempt12:20:131
796798321,3cyclictest121rcu_preempt12:20:131
7962983226,3cyclictest118550irq/29-4f00000.10:20:310
318932320,10sleep225-21ksoftirqd/211:45:232
796998316,21cyclictest7356-21wc09:45:422
7969983112,15cyclictest29051-21timerandwakeup10:30:402
796998311,15cyclictest16743-21ntpq08:55:462
796998311,14cyclictest14972-21df_inode11:10:202
796798313,4cyclictest121rcu_preempt12:07:591
7967983111,3cyclictest19-21ksoftirqd/111:15:351
7962983125,3cyclictest118550irq/29-4f00000.07:28:590
7962983120,6cyclictest10-21ksoftirqd/010:26:540
185752310,7sleep2251ksoftirqd/207:35:332
152492310,5sleep1191ksoftirqd/112:16:511
797298301,10cyclictest0-21swapper/311:55:023
796998302,23cyclictest15649-21basename10:05:002
7969983013,14cyclictest17001-21switchtime10:05:412
796998301,15cyclictest19124-21irqstats12:25:222
796798304,6cyclictest121rcu_preempt11:25:461
796798304,4cyclictest121rcu_preempt11:57:591
796798304,4cyclictest121rcu_preempt09:50:011
7967983015,4cyclictest19-21ksoftirqd/107:45:411
7967983015,3cyclictest19-21ksoftirqd/111:05:501
7967983014,9cyclictest19-21ksoftirqd/111:50:441
7967983013,4cyclictest19-21ksoftirqd/110:55:341
7967983013,4cyclictest19-21ksoftirqd/109:55:361
796298309,18cyclictest111rcuc/008:35:370
7962983025,3cyclictest1050ksoftirqd/012:22:280
7962983025,3cyclictest1050ksoftirqd/012:22:280
7962983021,7cyclictest10-21ksoftirqd/007:32:410
7962983021,7cyclictest10-21ksoftirqd/007:32:410
7962983021,6cyclictest10-21ksoftirqd/012:31:410
7962983020,7cyclictest10-21ksoftirqd/012:17:210
7962983012,8cyclictest28152-21runrttasks09:22:460
7962983012,8cyclictest28152-21runrttasks09:22:450
7972982919,4cyclictest31-21ksoftirqd/310:50:153
797298290,4cyclictest121rcu_preempt08:05:133
796998296,19cyclictest14340-21/usr/sbin/munin07:25:232
7969982913,13cyclictest6062-21open_files10:50:382
796998291,24cyclictest8756-21latency_hist12:05:012
796998291,24cyclictest31328-21/usr/sbin/munin09:30:172
796998291,24cyclictest21715-21rm07:45:152
796998291,24cyclictest13517-21latency_hist12:15:012
796998291,24cyclictest11113-21apt-get09:55:132
7969982910,16cyclictest22515-21proc_pri09:10:402
796798294,5cyclictest121rcu_preempt10:51:001
7967982914,3cyclictest19-21ksoftirqd/112:25:271
7967982913,4cyclictest19-21ksoftirqd/107:25:281
7967982913,3cyclictest19-21ksoftirqd/111:30:291
7967982912,3cyclictest19-21ksoftirqd/112:30:411
7967982912,3cyclictest19-21ksoftirqd/109:30:311
7967982911,3cyclictest19-21ksoftirqd/107:35:311
7962982910,16cyclictest111rcuc/010:10:230
100562290,2sleep30-21swapper/312:05:433
9002280,1sleep3527-21kworker/u8:511:48:343
797298284,5cyclictest29068-21apt-get11:40:133
797298281,3cyclictest121rcu_preempt10:25:003
7972982811,3cyclictest31-21ksoftirqd/311:05:163
797298281,12cyclictest13530-21aten2_rfpower_c10:00:163
796998284,21cyclictest20890-21/usr/sbin/munin09:05:472
796998283,22cyclictest2322-21/usr/sbin/munin11:50:312
796998281,24cyclictest16977-21runrttasks12:20:332
796998281,24cyclictest16977-21runrttasks12:20:322
796998281,23cyclictest29081-21runrttasks11:40:152
796998281,23cyclictest23821-21diskstats07:50:222
796998281,23cyclictest21604-21runrttasks10:15:372
796998281,22cyclictest27541-21/usr/sbin/munin08:00:192
796998281,14cyclictest15369-21sshd08:54:082
7969982811,14cyclictest0-21swapper/208:35:302
796798289,3cyclictest19-21ksoftirqd/111:10:141
796798288,12cyclictest121rcu_preempt10:15:291
796798287,4cyclictest121rcu_preempt11:45:121
7967982812,5cyclictest19-21ksoftirqd/107:10:211
7967982812,3cyclictest19-21ksoftirqd/110:05:191
7967982812,3cyclictest19-21ksoftirqd/109:50:241
7967982811,4cyclictest121rcu_preempt11:20:141
7967982811,3cyclictest19-21ksoftirqd/109:25:351
7967982811,3cyclictest19-21ksoftirqd/108:40:361
796298289,12cyclictest10-21ksoftirqd/008:10:380
796298289,12cyclictest10-21ksoftirqd/008:10:380
796298288,17cyclictest111rcuc/011:15:210
796298283,5cyclictest10-21ksoftirqd/012:25:210
796298282,9cyclictest30053-21ssh11:40:420
7962982819,6cyclictest10-21ksoftirqd/011:06:460
7962982818,8cyclictest10-21ksoftirqd/011:30:140
195202280,9sleep3301rcuc/311:20:123
797298271,5cyclictest121rcu_preempt09:07:593
796998276,12cyclictest154352kworker/u8:907:31:352
796998276,12cyclictest154352kworker/u8:907:31:352
796998271,23cyclictest27078-21sed11:35:242
796998271,23cyclictest25275-21munin-plugin-st10:24:592
796998271,23cyclictest19532-21sshd11:20:162
796998271,22cyclictest19413-21awk09:05:002
796998271,22cyclictest12351-21grep08:45:292
796998271,22cyclictest10834-21ntpq11:00:372
796998271,22cyclictest10834-21ntpq11:00:372
796998271,21cyclictest29151-21apt-get08:05:142
796798278,4cyclictest121rcu_preempt08:05:141
796798278,10cyclictest19-21ksoftirqd/108:45:481
796798277,3cyclictest121rcu_preempt09:10:381
796798276,8cyclictest121rcu_preempt10:27:571
796798271,3cyclictest121rcu_preempt10:00:151
7967982713,8cyclictest19-21ksoftirqd/112:10:211
7967982713,8cyclictest19-21ksoftirqd/111:35:411
7967982713,4cyclictest19-21ksoftirqd/109:40:321
7967982712,3cyclictest19-21ksoftirqd/109:05:371
7967982712,3cyclictest19-21ksoftirqd/108:50:411
796298279,11cyclictest10-21ksoftirqd/007:46:410
796298278,11cyclictest20355-21ssh11:20:310
796298278,10cyclictest121rcu_preempt10:33:240
796298271,5cyclictest0-21swapper/011:45:400
7962982710,9cyclictest10-21ksoftirqd/012:35:340
203852270,6sleep331-21ksoftirqd/310:14:583
797298263,5cyclictest31-21ksoftirqd/311:04:513
797298263,5cyclictest31-21ksoftirqd/311:04:513
797298262,4cyclictest121rcu_preempt09:10:393
797298261,4cyclictest0-21swapper/309:35:313
7972982613,3cyclictest31-21ksoftirqd/310:45:353
797298261,2cyclictest121rcu_preempt10:26:003
797298260,3cyclictest0-21swapper/309:55:383
796998261,22cyclictest363-21aten2_rfpower_v10:40:182
796998261,22cyclictest26441-21apt-get09:20:152
796998261,22cyclictest26441-21apt-get09:20:152
796998261,22cyclictest22290-21grep11:25:262
796998261,22cyclictest21343-21http07:45:012
796998261,22cyclictest1939-21ls09:35:272
796998261,22cyclictest0-21swapper/211:05:122
796998261,22cyclictest0-21swapper/210:45:122
796998261,22cyclictest0-21swapper/208:15:162
796998261,21cyclictest18749-21irqrtprio10:10:272
796798265,5cyclictest19-21ksoftirqd/111:00:291
796798265,5cyclictest19-21ksoftirqd/111:00:281
796798264,4cyclictest121rcu_preempt12:00:401
796798264,4cyclictest121rcu_preempt08:35:261
796798263,3cyclictest121rcu_preempt10:30:291
7967982611,8cyclictest19-21ksoftirqd/112:35:341
7967982611,4cyclictest19-21ksoftirqd/110:40:371
796298268,16cyclictest111rcuc/012:10:290
796298267,8cyclictest2443-21ssh11:50:410
796298267,13cyclictest111rcuc/011:25:260
796298266,9cyclictest0-21swapper/008:05:290
796298262,7cyclictest10-21ksoftirqd/009:10:140
7962982621,3cyclictest118550irq/29-4f00000.10:00:180
796298261,5cyclictest29795-21ssh09:25:390
796298260,4cyclictest10-21ksoftirqd/009:35:330
325862260,1sleep328038-21kworker/u8:809:30:563
279802260,5sleep3311ksoftirqd/309:22:003
279802260,5sleep3311ksoftirqd/309:21:593
235552260,5sleep331-21ksoftirqd/311:27:393
161572260,15sleep331-21ksoftirqd/311:11:313
797298259,8cyclictest121rcu_preempt07:15:313
797298252,3cyclictest0-21swapper/309:45:293
797298251,6cyclictest7971-21taskset08:35:073
797298251,4cyclictest121rcu_preempt10:19:593
797298251,4cyclictest121rcu_preempt07:35:003
797298251,4cyclictest121rcu_preempt07:35:003
797298251,3cyclictest121rcu_preempt12:10:343
797298251,3cyclictest121rcu_preempt09:40:593
797298251,11cyclictest7490-21ntp_states12:00:393
7972982510,3cyclictest31-21ksoftirqd/308:50:363
797298250,3cyclictest0-21swapper/312:35:313
796798255,4cyclictest121rcu_preempt08:00:231
796798254,4cyclictest121rcu_preempt07:20:371
7967982514,3cyclictest19-21ksoftirqd/108:15:261
7967982512,3cyclictest19-21ksoftirqd/110:10:321
7967982512,3cyclictest19-21ksoftirqd/109:35:091
7967982510,3cyclictest19-21ksoftirqd/108:20:281
796298253,7cyclictest10-21ksoftirqd/008:45:390
7962982521,2cyclictest118550irq/29-4f00000.08:16:000
796298251,7cyclictest0-21swapper/010:45:100
796298251,6cyclictest1328-21sshd11:10:140
7962982516,7cyclictest10-21ksoftirqd/007:57:150
797298249,3cyclictest31-21ksoftirqd/307:35:123
797298248,3cyclictest8999-21ssh09:50:313
797298247,3cyclictest31-21ksoftirqd/311:50:253
797298243,9cyclictest21546-21apt-get07:45:133
797298241,8cyclictest13870-21aten2_rfpower_p12:15:183
797298241,8cyclictest0-21swapper/310:55:323
797298241,7cyclictest10201-21aten2_rfpower_f08:40:263
797298241,6cyclictest8306-21aten2_rfpower_p07:10:193
797298241,6cyclictest12853-21ntpq08:45:443
797298241,4cyclictest0-21swapper/309:25:343
7972982412,3cyclictest31-21ksoftirqd/311:30:383
797298241,12cyclictest17428-21runrttasks10:06:513
797298241,11cyclictest2149-21rm10:43:373
7972982410,4cyclictest31-21ksoftirqd/312:30:303
7972982410,3cyclictest121rcu_preempt10:30:293
796798249,3cyclictest19-21ksoftirqd/107:50:211
796798247,3cyclictest19-21ksoftirqd/107:31:091
796798247,3cyclictest19-21ksoftirqd/107:31:091
7967982410,3cyclictest19-21ksoftirqd/109:00:201
796298248,5cyclictest121rcu_preempt09:06:590
796298246,6cyclictest121rcu_preempt07:40:000
7962982420,2cyclictest118550irq/29-4f00000.09:00:310
7962982419,3cyclictest118550irq/29-4f00000.10:15:230
796298241,8cyclictest0-21swapper/007:50:260
796298241,7cyclictest11121-21ssh09:55:140
317252240,5sleep331-21ksoftirqd/310:36:423
202272240,4sleep31983-21bootmenu12:27:503
797298239,3cyclictest31-21ksoftirqd/308:00:173
797298231,2cyclictest121rcu_preempt07:50:353
7972982310,3cyclictest31-21ksoftirqd/312:22:353
7972982310,3cyclictest31-21ksoftirqd/312:22:353
796298238,6cyclictest121rcu_preempt10:40:300
796298233,11cyclictest10-21ksoftirqd/012:00:220
7962982319,2cyclictest118550irq/29-4f00000.10:35:190
796298231,15cyclictest10-21ksoftirqd/011:00:350
796298231,15cyclictest10-21ksoftirqd/011:00:340
7962982310,11cyclictest10-21ksoftirqd/010:10:000
191292230,1sleep315143-21kworker/u8:1609:01:423
797298229,3cyclictest31-21ksoftirqd/307:25:183
797298221,9cyclictest581-21grep08:15:193
797298221,3cyclictest121rcu_preempt08:10:383
797298221,3cyclictest121rcu_preempt08:10:383
797298221,10cyclictest0-21swapper/307:55:343
796298227,7cyclictest121rcu_preempt09:50:230
796298223,9cyclictest10-21ksoftirqd/010:56:510
7962982217,3cyclictest118550irq/29-4f00000.09:45:010
796298217,11cyclictest111rcuc/009:35:000
796298214,2cyclictest0-21swapper/008:00:170
796298211,11cyclictest121rcu_preempt12:05:170
7962982011,7cyclictest10-21ksoftirqd/008:51:350
796298168,6cyclictest8030-21latency_hist07:10:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional