You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 23:47

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Phytec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot5s.osadl.org (updated Tue May 12, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
980732995749,4cyclictest995492-21cut07:50:170
980732995221,11cyclictest1074757-21/usr/sbin/munin11:40:140
980740995138,8cyclictest1043407-21sshd10:10:152
980736995135,12cyclictest231ktimers/108:55:121
980732994919,11cyclictest1015878-21cpuspeed08:50:140
980740994738,5cyclictest1007073-21idleruntime-cro08:25:022
980732994618,10cyclictest645-21runrttasks12:05:180
980740994533,7cyclictest1074409-21apt11:40:002
980732994529,12cyclictest1050918-21/usr/sbin/munin10:30:240
980732994520,6cyclictest981338-21meminfo07:10:200
980732994520,6cyclictest1029448-21munin-run09:30:010
980732994516,10cyclictest993411-21latency_hist07:45:020
980740994436,5cyclictest1095308-21sendmail12:40:002
980732994424,14cyclictest1067843-21apt-get11:20:120
980732994417,12cyclictest1072438-21chrt11:31:470
980732994415,11cyclictest1041081-21taskset10:01:240
980732994414,16cyclictest1045023-21cpu10:15:140
980740994335,6cyclictest311ktimers/207:55:112
980732994324,14cyclictest1026798-21/usr/sbin/munin09:20:200
980732994323,8cyclictest1092575-21memory12:30:180
980732994323,7cyclictest1046736-21/usr/sbin/munin10:20:100
980732994320,5cyclictest991497-21munin-run07:40:010
980732994314,10cyclictest1035374-21ntp_states09:45:230
980732994314,10cyclictest1035374-21ntp_states09:45:220
980743994236,4cyclictest991398-21kworker/u8:2+events_unbound07:39:473
980740994230,8cyclictest1025607-21grep09:15:252
98073699421,14cyclictest991033-21grep07:35:271
98073699421,12cyclictest1029435-21cron09:30:001
980732994235,4cyclictest1063570-21unixbench_singl11:05:260
980732994217,9cyclictest1058995-21apt-config10:55:010
980732994217,9cyclictest1058995-21apt-config10:55:010
980732994214,11cyclictest986043-21cron07:21:010
980740994134,4cyclictest1022401-21latency_hist09:10:002
980740994134,4cyclictest1022401-21latency_hist09:10:002
98073699419,4cyclictest0-21swapper/110:10:221
980736994133,5cyclictest1005368-21sendmail08:20:011
980736994129,10cyclictest231ktimers/110:40:131
98073699411,9cyclictest1045550-21grep10:15:211
980736994112,4cyclictest1-21systemd09:15:021
980736994112,3cyclictest1067983-21fschecks_count11:20:161
980736994112,3cyclictest1058668-21latency_hist10:55:001
980736994112,3cyclictest0-21swapper/109:10:211
980732994129,8cyclictest1015649-21grep08:50:010
980732994115,11cyclictest1022415-21idleruntime-cro09:10:000
980732994115,11cyclictest1022415-21idleruntime-cro09:10:000
980743994029,7cyclictest984689-21sendmail07:20:023
980743994025,6cyclictest982213-21kworker/u8:3+events_unbound07:30:263
98073699408,4cyclictest0-21swapper/111:05:001
98073699408,4cyclictest0-21swapper/111:05:001
980736994032,4cyclictest0-21swapper/108:29:541
980736994031,6cyclictest1020282-21grep09:00:281
980736994031,6cyclictest1020282-21grep09:00:271
980736994016,21cyclictest0-21swapper/107:45:241
980732994033,4cyclictest1091471-21unixbench_singl12:25:250
980732994024,3cyclictest983086-21meminfo07:15:040
980732994022,13cyclictest1039203-21tail09:55:250
980732994018,19cyclictest1095292-21cron12:40:000
980743993933,4cyclictest1030820-21kworker/u8:0+events_unbound09:40:103
980743993931,4cyclictest0-21swapper/311:40:003
980743993926,9cyclictest0-21swapper/307:30:013
980740993930,7cyclictest311ktimers/212:20:112
980740993928,8cyclictest1075652-21tail11:40:252
980740993928,8cyclictest1017279-21sh08:55:012
98073699397,6cyclictest1053364-21latency_hist10:40:001
980736993914,3cyclictest1029679-21/usr/sbin/munin09:30:161
980736993914,21cyclictest0-21swapper/111:35:241
980736993911,7cyclictest1036319-21date09:50:001
980736993911,7cyclictest1036319-21date09:50:001
98073699391,12cyclictest1067583-21cron11:20:001
980736993910,3cyclictest0-21swapper/108:45:131
980732993931,4cyclictest1079761-21apt-get11:55:150
980732993928,8cyclictest1002294-21/usr/sbin/munin08:10:160
980732993927,7cyclictest1001230-21/usr/sbin/munin08:05:230
980732993926,10cyclictest993691-21/usr/sbin/munin07:45:180
980732993924,10cyclictest1004033-21/usr/sbin/munin08:15:160
980732993922,13cyclictest1052853-21unixbench_multi10:35:260
980732993921,13cyclictest1017825-21if_eth108:55:170
980732993921,13cyclictest1009107-21df_inode08:30:130
980732993920,13cyclictest1024593-21cpu09:15:130
980743993832,4cyclictest978658-21kworker/u8:0+events_unbound07:14:393
980743993831,5cyclictest1032811-21kworker/u8:3+events_unbound09:45:093
980743993831,5cyclictest1032811-21kworker/u8:3+events_unbound09:45:093
980743993830,6cyclictest1005009-21kworker/u8:0+events_unbound08:54:593
980743993826,7cyclictest0-21swapper/311:10:253
980740993830,6cyclictest311ktimers/209:20:122
980736993830,5cyclictest1032838-21cron09:40:001
980736993817,18cyclictest0-21swapper/110:55:171
980736993817,18cyclictest0-21swapper/110:55:161
980736993812,3cyclictest0-21swapper/109:40:231
980736993812,23cyclictest0-21swapper/112:30:241
98073699381,11cyclictest981887-21tail07:10:261
98073699381,11cyclictest1041378-21cron10:05:001
980732993828,7cyclictest1061425-21/usr/sbin/munin11:00:250
980732993828,7cyclictest1061425-21/usr/sbin/munin11:00:240
980732993827,7cyclictest1078176-21diskstats11:50:150
980732993827,7cyclictest1012947-21/usr/sbin/munin08:40:200
980732993824,11cyclictest1089729-21cron12:21:590
980732993821,13cyclictest1032432-21grep09:35:260
980732993821,10cyclictest0-21swapper/010:25:120
980732993820,13cyclictest998858-21ls08:00:150
980732993817,7cyclictest1064756-21/usr/sbin/munin11:10:210
98073699378,6cyclictest1062882-21wc11:05:191
980736993716,18cyclictest0-21swapper/107:50:171
980736993712,3cyclictest1090267-21latency_hist12:25:001
980732993727,7cyclictest1087562-21/usr/sbin/munin12:15:240
980732993727,7cyclictest1006884-21cron08:23:010
980732993726,8cyclictest989691-21cron07:34:000
980732993726,8cyclictest1033407-21/usr/sbin/munin09:40:170
980732993725,9cyclictest1073053-21/usr/sbin/munin11:35:150
980732993724,10cyclictest998489-21sshd07:59:480
980732993724,10cyclictest1058467-21cron10:53:000
980732993722,12cyclictest0-21swapper/009:10:130
980732993722,11cyclictest1019439-21tune2fs09:00:170
980732993722,11cyclictest1019439-21tune2fs09:00:170
980732993721,13cyclictest986673-21/usr/sbin/munin07:25:160
980732993720,3cyclictest1041731-21df10:05:150
980732993719,15cyclictest1077391-21head11:45:260
980732993719,12cyclictest1007501-21grep08:25:170
980732993714,8cyclictest645-21runrttasks11:27:010
980732993714,8cyclictest645-21runrttasks11:27:000
980743993620,11cyclictest391ktimers/308:35:123
980740993628,4cyclictest0-21swapper/210:10:012
980740993625,7cyclictest1058197-21grep10:50:262
980736993628,4cyclictest1039685-21sendmail10:00:001
980736993628,4cyclictest0-21swapper/111:40:171
980736993612,4cyclictest231ktimers/108:15:011
980736993612,2cyclictest0-21swapper/110:29:321
980736993611,3cyclictest1048333-21latency_hist10:25:011
98073699361,10cyclictest997207-21tune2fs07:55:151
98073699361,10cyclictest1051598-21cron10:35:011
980732993626,7cyclictest1084997-21diskstats12:10:140
980732993626,7cyclictest1082172-21/usr/sbin/munin12:00:240
980732993626,7cyclictest1055917-21meminfo10:45:190
980732993626,7cyclictest1053897-21/usr/sbin/munin10:40:170
980732993626,7cyclictest1036772-21/usr/sbin/munin09:50:160
980732993626,7cyclictest1036772-21/usr/sbin/munin09:50:160
980732993626,7cyclictest1030130-21/usr/sbin/munin09:30:200
980732993625,8cyclictest1043438-21df_inode10:10:160
980732993621,12cyclictest1066229-21/usr/sbin/munin11:15:140
980743993529,4cyclictest1018684-21kworker/u8:3+events_unbound09:18:423
980743993528,5cyclictest1008622-21kworker/u8:1+events_unbound08:34:553
980743993528,4cyclictest995134-21apt-key07:50:023
980740993528,4cyclictest0-21swapper/209:15:012
980740993527,4cyclictest1053321-21idleruntime-cro10:40:002
980736993512,4cyclictest231ktimers/108:20:181
980736993511,5cyclictest0-21swapper/111:50:191
98073699351,11cyclictest1065695-21apt-get11:15:001
980743993427,3cyclictest0-21swapper/309:55:163
980740993426,4cyclictest0-21swapper/211:55:182
980740993423,8cyclictest1046969-21cut10:20:162
98073699349,7cyclictest1071015-21ls11:30:001
98073699349,7cyclictest1071015-21ls11:30:001
980736993411,5cyclictest231ktimers/109:05:141
980736993411,5cyclictest231ktimers/109:05:141
980743993327,4cyclictest986616-21kworker/u8:0+events_unbound07:59:483
980743993324,5cyclictest0-21swapper/311:50:263
980743993311,5cyclictest131rcu_preempt11:00:143
980743993311,5cyclictest131rcu_preempt11:00:133
980740993324,4cyclictest0-21swapper/209:35:272
980740993322,8cyclictest982353-21cron07:15:012
980736993312,4cyclictest231ktimers/110:45:131
980743993226,4cyclictest1040472-21kworker/u8:2+events_unbound10:05:123
980743993225,3cyclictest0-21swapper/309:55:013
980743993225,3cyclictest0-21swapper/309:55:003
980743993224,5cyclictest1052886-21grep10:35:263
980743993223,6cyclictest992737-21unixbench_multi07:40:263
980743993217,7cyclictest1030820-21kworker/u8:0+events_unbound10:43:183
980743993217,5cyclictest1065295-21kworker/u8:0+events_unbound11:57:083
980743993217,5cyclictest1048067-21kworker/u8:1+events_unbound10:26:193
980743993211,11cyclictest40-21ksoftirqd/310:05:003
980740993224,4cyclictest0-21swapper/209:45:162
980740993224,4cyclictest0-21swapper/209:45:162
980740993222,5cyclictest0-21swapper/207:40:002
98073699324,7cyclictest0-21swapper/112:15:001
980736993224,4cyclictest0-21swapper/108:50:261
980736993222,7cyclictest1010013-21grep08:30:231
980736993210,4cyclictest231ktimers/112:05:141
980743993124,5cyclictest1065295-21kworker/u8:0+events_unbound12:15:433
980743993124,4cyclictest0-21swapper/308:05:253
980743993123,6cyclictest1024292-21kworker/u8:2+events_unbound09:30:413
980743993118,5cyclictest1077699-21kworker/u8:3+events_unbound12:12:413
980740993121,5cyclictest0-21swapper/211:00:002
980740993121,5cyclictest0-21swapper/211:00:002
98074399309,11cyclictest131rcu_preempt10:55:003
980743993023,4cyclictest0-21swapper/311:20:273
980743993022,6cyclictest1018684-21kworker/u8:3+events_unbound09:29:123
980743993015,7cyclictest1072381-21kworker/u8:3+events_unbound11:32:203
980743993011,5cyclictest131rcu_preempt09:00:253
980743993011,5cyclictest131rcu_preempt09:00:253
980740993023,4cyclictest982213-21kworker/u8:3+events_unbound07:24:422
980740993022,4cyclictest0-21swapper/211:15:252
980740993022,4cyclictest0-21swapper/210:25:242
980740993018,8cyclictest984179-21grep07:15:252
980736993021,6cyclictest1000240-21sh08:05:021
98074399299,11cyclictest40-21ksoftirqd/309:05:263
98074399299,11cyclictest40-21ksoftirqd/309:05:253
98074399298,13cyclictest40-21ksoftirqd/310:45:153
98074399297,4cyclictest0-21swapper/309:15:013
980743992912,10cyclictest0-21swapper/311:28:543
980743992912,10cyclictest0-21swapper/311:28:533
980743992911,11cyclictest0-21swapper/308:12:203
980740992920,5cyclictest993208-21apt07:45:002
980736992912,3cyclictest1012551-21fschecks_count08:40:161
98074399289,7cyclictest40-21ksoftirqd/308:55:163
98074399287,11cyclictest40-21ksoftirqd/308:25:013
980743992822,3cyclictest0-21swapper/311:05:263
980743992821,3cyclictest0-21swapper/312:00:263
980743992821,3cyclictest0-21swapper/310:15:013
980743992820,6cyclictest999855-21kworker/u8:2+events_unbound08:19:543
980743992812,7cyclictest1060505-21kworker/u8:1+events_unbound11:43:063
980743992810,11cyclictest0-21swapper/307:24:083
980740992818,7cyclictest989355-21grep07:30:282
980736992822,3cyclictest0-21swapper/112:40:001
980736992819,6cyclictest0-21swapper/111:50:011
98074399279,4cyclictest131rcu_preempt11:15:163
98074399278,5cyclictest131rcu_preempt10:20:213
98074399278,11cyclictest131rcu_preempt12:20:233
98074399277,12cyclictest131rcu_preempt07:50:013
98074399275,10cyclictest131rcu_preempt10:59:303
98074399275,10cyclictest131rcu_preempt10:59:303
980743992721,4cyclictest1087902-21kworker/u8:4+events_unbound12:27:423
980743992721,4cyclictest1082635-21kworker/u8:2+events_unbound12:07:083
98074399271,8cyclictest40-21ksoftirqd/309:20:263
980743992716,8cyclictest391ktimers/308:25:133
980743992716,4cyclictest1027393-21kworker/u8:1+events_unbound09:37:173
980743992710,6cyclictest40-21ksoftirqd/308:45:163
980740992721,3cyclictest0-21swapper/208:15:012
980740992719,5cyclictest0-21swapper/208:50:002
980740992718,7cyclictest1061666-21sort11:00:262
980740992718,7cyclictest1061666-21sort11:00:262
980740992717,6cyclictest1020708-21munin-plugin-st09:05:002
980740992717,6cyclictest1020708-21munin-plugin-st09:05:002
980740992714,10cyclictest311ktimers/211:25:132
980740992714,10cyclictest311ktimers/211:25:132
980736992721,3cyclictest0-21swapper/112:15:121
980736992719,4cyclictest0-21swapper/112:25:241
980736992718,6cyclictest0-21swapper/109:50:161
980736992718,6cyclictest0-21swapper/109:50:161
98074399267,11cyclictest40-21ksoftirqd/308:05:013
98074399266,10cyclictest40-21ksoftirqd/312:35:213
980743992613,5cyclictest1005009-21kworker/u8:0+events_unbound08:40:363
980740992620,3cyclictest0-21swapper/211:05:202
980740992619,3cyclictest0-21swapper/208:25:212
980740992617,6cyclictest999772-21grep08:00:272
980740992617,6cyclictest0-21swapper/207:55:002
980740992616,6cyclictest1039921-21/usr/sbin/munin10:00:162
980736992616,7cyclictest1026438-21fschecks_count09:20:171
980736992616,6cyclictest0-21swapper/108:05:251
98074399256,11cyclictest40-21ksoftirqd/311:50:013
980743992517,6cyclictest1077699-21kworker/u8:3+events_unbound12:30:323
98074399251,6cyclictest0-21swapper/310:15:243
980740992517,4cyclictest1065677-21idleruntime-cro11:15:012
980740992513,8cyclictest1056951-21basename10:50:002
980736992518,4cyclictest0-21swapper/108:40:001
98074399241,14cyclictest0-21swapper/310:33:573
980740992416,6cyclictest53-21kcompactd012:05:202
980740992416,4cyclictest1000707-21cut08:05:162
98073699242,19cyclictest1072705-21debian-sa111:35:001
980736992417,4cyclictest0-21swapper/112:00:231
980736992417,4cyclictest0-21swapper/107:30:181
980740992317,3cyclictest0-21swapper/212:15:252
980740992317,3cyclictest0-21swapper/208:30:092
980740992316,4cyclictest0-21swapper/207:50:012
980740992315,4cyclictest1086476-21latency_hist12:15:022
980740992313,6cyclictest0-21swapper/210:15:212
980740992312,7cyclictest0-21swapper/212:25:192
980736992314,6cyclictest231ktimers/107:15:021
980740992216,3cyclictest0-21swapper/209:30:252
980740992215,4cyclictest1028548-21ntpq09:25:222
980740992215,3cyclictest0-21swapper/212:00:252
980740992215,3cyclictest0-21swapper/211:45:152
980740992215,3cyclictest0-21swapper/211:25:002
980740992214,5cyclictest0-21swapper/211:30:162
980740992214,5cyclictest0-21swapper/210:30:252
980740992212,7cyclictest1018974-21cron09:00:002
98074099212,13cyclictest1004925-21unixbench_singl08:15:262
980740992116,3cyclictest1033238-21fschecks_count09:40:152
980740992115,3cyclictest1038748-21ntpq09:55:222
980740992112,6cyclictest0-21swapper/211:50:172
980740992111,6cyclictest311ktimers/207:30:022
980736992115,3cyclictest0-21swapper/107:40:241
980736992112,6cyclictest985546-21wc07:20:241
980736992112,5cyclictest0-21swapper/107:25:201
98074099209,8cyclictest1092213-21awk12:30:122
980740992014,4cyclictest3260392-1kworker/2:0H+kblockd10:45:002
980740992013,4cyclictest0-21swapper/209:50:252
980740992013,4cyclictest0-21swapper/209:50:252
98074099199,7cyclictest1011947-21seq08:37:322
980736991913,3cyclictest0-21swapper/111:55:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional